-- Logs begin at Tue 2022-07-12 13:44:37 UTC, end at Tue 2022-07-12 14:58:39 UTC. -- Jul 12 14:30:17.848160 dv-cinder-820027-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 12 14:30:17.857456 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 12 14:30:17.859812 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 14:30:17 2022] *** Jul 12 14:30:17.859812 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 14:30:17.859812 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 14:30:17.859812 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: nodename: dv-cinder-820027-12-iscsi Jul 12 14:30:17.859812 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: machine: x86_64 Jul 12 14:30:17.859812 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: clock source: unix Jul 12 14:30:17.859812 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: pcre jit disabled Jul 12 14:30:17.859812 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: detected number of CPU cores: 4 Jul 12 14:30:17.859812 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: current working directory: / Jul 12 14:30:17.859812 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: detected binary path: /usr/bin/uwsgi-core Jul 12 14:30:17.859812 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: your processes number limit is 47680 Jul 12 14:30:17.859812 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: your memory page size is 4096 bytes Jul 12 14:30:17.859812 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: detected max file descriptor number: 2048 Jul 12 14:30:17.859812 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: lock engine: pthread robust mutexes Jul 12 14:30:17.859812 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: thunder lock: enabled Jul 12 14:30:17.860671 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 12 14:30:17.860671 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 14:30:17.903821 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: Python main interpreter initialized at 0x564b7b0089c0 Jul 12 14:30:17.903821 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: python threads support enabled Jul 12 14:30:17.903821 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: your server socket listen backlog is limited to 100 connections Jul 12 14:30:17.903821 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: your mercy for graceful operations on workers is 90 seconds Jul 12 14:30:17.904233 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 14:30:17.904233 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: *** Operational MODE: preforking *** Jul 12 14:30:17.904489 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: *** uWSGI is running in multiple interpreter mode *** Jul 12 14:30:17.904489 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: spawned uWSGI master process (pid: 104581) Jul 12 14:30:17.904702 dv-cinder-820027-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 12 14:30:17.909200 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: spawned uWSGI worker 1 (pid: 104582, cores: 1) Jul 12 14:30:17.909200 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: spawned uWSGI worker 2 (pid: 104583, cores: 1) Jul 12 14:30:17.909200 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 14:30:18.561633 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 14:30:18.578451 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 14:30:19.676959 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 14:30:19.676959 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: from cryptography.utils import int_from_bytes Jul 12 14:30:19.677589 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 14:30:19.677589 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: from cryptography.utils import int_from_bytes Jul 12 14:30:19.678959 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 14:30:19.678959 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: from cryptography.utils import int_from_bytes Jul 12 14:30:19.679385 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 14:30:19.679385 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: from cryptography.utils import int_from_bytes Jul 12 14:30:22.152228 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 14:30:22.152776 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 14:30:22.152992 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 14:30:22.153367 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 14:30:22.153481 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 14:30:22.153823 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 14:30:22.153893 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 14:30:22.153985 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.154140 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 14:30:22.154296 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.154498 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 14:30:22.154613 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.154750 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 14:30:22.154927 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.155140 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.155234 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.155465 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.155568 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.155784 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.155885 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.156099 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.156201 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.156427 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.156529 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.157447 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.157561 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.157642 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.157718 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.157797 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-12-iscsi {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.157866 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.157940 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.158019 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.158093 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.158161 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.158236 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.158304 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.158510 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.158671 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-12-iscsi {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.158797 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.158933 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.159098 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.159228 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.159398 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.159547 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.159735 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.159878 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.160037 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.161003 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.161143 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.161322 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.161466 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.161621 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.161790 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.161931 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.162073 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.162206 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.162348 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.162482 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.162567 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.162654 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.162736 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.162862 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.162955 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.163037 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.163189 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.163321 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.163453 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.163597 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.163838 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-12-iscsi {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.163962 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.164150 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.164245 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.164455 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.164550 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-12-iscsi {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.164762 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.164918 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.165181 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.165271 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.165488 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.165593 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.165793 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.165911 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.166108 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.166224 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.166427 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.166527 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.166731 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.166839 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.167052 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.167165 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.167366 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.167521 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.167681 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.167770 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.167996 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.168092 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.168292 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.168390 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.168593 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.168703 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.168897 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.169005 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.169234 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.169325 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.169537 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.169623 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.169842 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.169978 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.170081 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.170237 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.170375 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.170543 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.170689 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.170777 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.171003 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.171092 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.171319 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.171429 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.171566 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.171700 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.171810 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.172021 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.172110 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.172281 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.172421 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.172527 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.172722 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.172811 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.173023 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.173135 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.173355 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.173461 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.173664 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.173756 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.173960 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.174061 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.174259 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.174356 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.174559 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.174647 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.174875 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.174992 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.175169 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.175270 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.175477 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.175575 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.175793 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.175894 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.176096 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.176191 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.176408 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.176496 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.176716 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.176814 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.177032 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.177118 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.177357 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.177462 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.177689 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.177787 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.177995 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.178089 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.178296 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.178383 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.178609 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.178716 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.178950 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.179038 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.179251 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.179341 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.179550 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.179640 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.179853 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.179949 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.180166 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.180265 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.180472 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.180561 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.180784 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.180885 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.181026 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.181132 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.181348 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.181440 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.181648 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.181735 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.181951 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.182039 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.182253 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.182340 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.182553 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.182655 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.182853 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.182948 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.183148 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.183237 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.183447 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.183541 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.183747 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.183848 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.184047 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.184137 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.184346 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.184432 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.184645 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.184745 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.184942 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.185032 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.185263 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.185355 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.185564 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.185664 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.185861 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.185950 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.186162 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.186250 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.186468 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.186569 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.186767 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.186854 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.187067 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.187155 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.187366 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.187494 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.187663 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.187761 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.187968 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.188065 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.188264 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.188361 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.188563 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.188651 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.188875 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.188963 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.189207 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.189318 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.189492 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.189582 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.189802 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.189893 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.190099 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.190200 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.190397 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.190485 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.190707 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.190795 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.190998 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.191087 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.191296 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.191385 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.191602 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.191698 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.191898 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.191987 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.192193 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.192281 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.192486 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.192573 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.192781 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.192870 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.193076 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.193186 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.193395 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.193487 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.193691 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.193783 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.193988 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.194077 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.194279 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.194384 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.195116 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.195250 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.195420 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.195508 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.195721 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.195817 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.196022 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.196111 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.196318 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.196406 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.196629 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.196730 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.196929 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.197017 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.197272 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:30:22.197366 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.197607 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.197712 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.197914 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.198008 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.198241 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.198337 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.198566 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.198656 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.198881 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.198975 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.199188 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.199278 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.199503 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.199600 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.199820 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.199907 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.200124 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.200246 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.200434 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.200584 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.200743 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.200833 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.201053 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.201151 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.201389 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.201476 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.201708 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.201824 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.202017 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.202108 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.202328 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.202418 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.202638 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.202727 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.202943 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.203030 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.203255 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.203354 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.203563 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.203658 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.203880 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.203977 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.204184 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.204320 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.204516 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.204605 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.204909 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.205050 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.205242 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.205379 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.205562 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.205699 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.205879 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.206014 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.206186 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.206340 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.206491 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.206661 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.206794 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.206974 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.207109 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.207285 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.207433 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.207593 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.207740 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.207914 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.208039 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.208248 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.208337 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.208564 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.208666 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.208883 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.208973 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.209222 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.209313 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.209537 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.209639 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.209847 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.209936 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.210204 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.210855 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.211009 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.211114 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.211314 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.211402 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.211625 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.211722 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.211932 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.212023 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.212236 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.212324 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.212539 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.212627 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.212840 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.212930 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.213138 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.213277 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.213456 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.213555 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.213759 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.213863 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.214056 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.214152 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.214366 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.214454 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.214674 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.214764 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.214975 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.215071 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.215293 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.215395 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.215594 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.215691 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.215897 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.215994 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.216200 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.216301 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.216523 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.216612 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.216825 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.216922 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.217132 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.217327 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.217458 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.217559 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.217757 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.217845 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.218074 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.218173 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.218378 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.218466 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.218677 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.218772 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.218995 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.219085 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.219295 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.219385 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.219601 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.219690 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.219909 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.219998 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.220215 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.220303 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.220521 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.220617 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.220825 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.220954 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.221131 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.221286 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.221467 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.221555 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.221775 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.221867 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.222083 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.222170 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.222405 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.222501 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.222724 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.222821 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.223021 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.223116 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.223342 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.223440 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.223662 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.223752 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.223973 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.224072 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.224273 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.224372 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.224576 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.224675 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.224874 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.224963 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.225191 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.225302 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.225494 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.225584 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.225819 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.225915 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.226120 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.226210 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.226420 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.226510 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.226719 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.226807 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.227016 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.227106 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.227313 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.227410 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.227617 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.227716 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.227920 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.228008 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.228218 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.228306 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.228516 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.228613 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.228815 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.228913 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.229125 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.229254 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.229452 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.229550 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.229757 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.229847 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.230101 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.230189 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.230408 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.230505 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.230725 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.230826 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.231033 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.231120 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.231343 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.231440 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.231648 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.231738 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.231954 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.232044 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.232260 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.232358 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.232564 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.232654 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.232877 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.232964 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.233210 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.233343 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.233527 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.233637 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.233828 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.233926 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.234147 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.234244 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.234452 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.234573 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.234758 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.234854 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.235058 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.235146 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.235366 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.235454 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.235687 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.235786 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.235991 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.236081 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.236306 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.236393 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.236617 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.236704 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.236924 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.237014 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.237257 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.237360 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.237563 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.237660 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.237867 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.237969 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.238173 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.238273 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.238475 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.238576 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.238787 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.238874 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.239094 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.239182 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.239404 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.239498 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.239707 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.239794 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.240023 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.240111 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.240326 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.240424 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.240638 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.240724 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.240935 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.241021 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.241265 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.241872 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.242120 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.242224 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.242427 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.242516 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.242744 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.242833 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.243072 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.243159 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.243389 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.243477 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.243694 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.243791 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.243998 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.244084 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.244304 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.244391 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.244604 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.244691 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.244906 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.245009 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.245230 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.245322 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.245540 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.245628 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.245845 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.245940 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.246149 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.246319 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.246448 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.246536 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.246755 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.246844 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.247058 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.247154 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.247356 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.247451 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.247654 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.247742 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.247959 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.248058 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.248263 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.248369 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.248567 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.248654 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.248879 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.248974 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.249209 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.249311 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.249520 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.249610 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.249821 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.249909 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.250138 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.250233 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.250442 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.250527 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.250739 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.250827 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.251036 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.251124 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.251336 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.251442 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.251644 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.251739 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.251948 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.252036 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.252252 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.252339 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.252562 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.252651 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.252877 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.253035 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.253199 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.253302 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.253515 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.253602 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.253822 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.253910 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.254126 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.254221 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.254443 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.254529 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.254750 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.254836 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.255055 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.255150 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.255361 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.255448 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.255667 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.255764 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.255974 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.256075 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.256279 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.256374 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.256591 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.256678 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.256895 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.256983 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.257822 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.257924 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.258130 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.258219 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.258434 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.258535 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.258739 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.258826 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.259051 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.259138 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.259361 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.259621 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.259709 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.259951 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.260040 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.260263 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.260530 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.260618 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.260867 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.260953 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.261463 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.261618 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.261780 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.261877 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.262102 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.262218 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.262422 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.262547 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.262728 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.262852 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.263037 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.263389 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.263522 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.263632 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.263754 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.263880 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.264229 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.264365 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.264481 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.264599 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.264717 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.264840 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.264958 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.265066 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.265208 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.265324 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.265432 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.265558 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.265681 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.265798 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.265944 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.266086 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.266245 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.266395 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.266554 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.266701 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.266853 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.267008 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.267161 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.267314 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.267462 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.267632 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.267778 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.267939 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.268083 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.268253 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.268381 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.268564 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.268689 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.268889 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.268996 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.269220 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.269317 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.269529 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.269632 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.269835 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.269934 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.270140 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.270229 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.270483 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.270582 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.270789 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.270964 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.271128 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.271218 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.271447 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.271543 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.271754 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.271852 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.272055 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.272144 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.272356 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.272444 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.272685 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.272792 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.272992 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.273089 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.273319 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.273408 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.273625 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.273727 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.273929 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.274018 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.274236 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.274332 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.274539 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.274627 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.274848 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.275022 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.275157 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.275309 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.275456 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.275603 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.275740 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.275882 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.276016 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.276112 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.276304 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.276393 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.276603 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.276690 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.276908 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.277011 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.277236 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.277331 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.277537 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.277670 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.277839 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.277942 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.278137 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.278224 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.278443 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.278537 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.278745 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.278844 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.279043 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.279141 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.279342 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.279430 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.279650 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.279739 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.279953 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.280047 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.280250 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.280336 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.280553 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.280640 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.280861 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.280961 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.281177 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.281274 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.281478 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.281575 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.281783 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.281891 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.282081 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.282181 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.282378 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.282465 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.282680 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.282775 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.282987 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.283083 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.283291 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.283379 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.283588 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.283675 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.283890 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.283987 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.284190 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.284277 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.284490 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.284619 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.284791 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.284892 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.285094 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.285204 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.285416 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.285516 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.285716 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.285805 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.286012 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.286099 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.286310 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.286404 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.286608 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.286697 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.286911 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.286997 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.287217 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.287310 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.287516 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.287604 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.287813 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.287904 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.288108 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.288203 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.288450 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.288541 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.288768 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.288902 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.289063 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.289211 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.289394 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.289486 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.289733 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.289831 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.290035 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.290134 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.290339 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.290426 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.290645 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.290742 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.290954 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.291051 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.291254 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.291341 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.291565 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.291651 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.291873 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.291982 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.292177 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.292272 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.292475 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.292571 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.292772 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.292861 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.293083 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.293190 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.293429 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.293526 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.293734 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.293821 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.294038 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.294124 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.294353 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.294440 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.294665 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.294755 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.294962 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.295048 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.295266 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.295352 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.295571 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.295660 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.295874 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.295962 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.296179 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.296273 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.296482 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.296571 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.296786 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.296873 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.297092 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.297218 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.297423 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.297510 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.297729 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.297865 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.298036 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.298134 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.298337 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.298425 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.298642 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.298729 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.298942 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.299111 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.299242 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.299329 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.299544 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.299629 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.299857 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.299955 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.300153 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.300245 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.300455 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.300543 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.300753 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.300841 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.301056 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.301144 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.301386 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.301473 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.301693 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.301807 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.302003 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.302102 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.302313 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.302400 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.302619 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.302708 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.302990 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.303086 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.303296 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.303384 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.303607 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.303704 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.304444 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.304540 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.304745 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.304843 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.305077 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.305213 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.305423 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.305514 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.305741 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.305837 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.306047 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.306135 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.306345 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.306466 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.306642 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.306780 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.306946 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.307092 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.307264 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.307402 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.307562 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.307708 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.307858 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.308011 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.308155 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.308320 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.308471 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.308643 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.308770 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.308951 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.309079 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.309280 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.309504 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.309595 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.309809 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.309896 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.310113 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.310201 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.310491 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.310579 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.310811 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.310906 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.311114 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.311210 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.311432 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.311520 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.311748 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.311905 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.312068 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.312201 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.312368 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.312514 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.312672 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.312836 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.312974 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.313204 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.313312 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.313505 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.313603 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.313811 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.313907 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.314125 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.314212 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.314436 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.314526 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.314768 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.314855 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.315092 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.315180 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.315398 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.315486 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.315709 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.315795 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.316014 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.316110 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.316336 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.316426 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.316659 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.316747 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.316971 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.317066 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.317326 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.317417 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.317628 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.317744 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.317928 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.318075 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.318234 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.318367 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.318534 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.318690 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.318834 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.319015 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.319151 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.319322 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.319451 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.320163 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.320301 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.320478 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.320609 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.320786 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.320914 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.321094 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.321222 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.321443 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.321539 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.321751 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.321841 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.322064 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.322175 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.322380 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.322480 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.322688 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.322777 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.322994 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.323100 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.323300 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.323390 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.323609 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.323696 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.323917 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.324012 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.324220 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.324317 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.324519 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.324607 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.324819 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.324917 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.325117 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.325227 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.325475 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.325566 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.325777 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.325867 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.326092 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.326182 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.326395 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.326538 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.326704 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.326794 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.327008 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.327096 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.327330 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.327428 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.327647 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.327741 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.327955 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.328041 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.328266 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.328367 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.328625 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.328832 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.328942 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.329144 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.329303 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.329467 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.329626 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.329786 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.329945 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.330062 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.330266 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.330364 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.330592 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.330688 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.330899 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.330987 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.331205 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.331294 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.331515 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.331609 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.331812 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.331899 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.332117 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.332205 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.332423 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.332539 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.332730 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.332822 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.333033 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.333125 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.333357 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.333448 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.333658 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.333760 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.333956 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.334047 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.334274 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.334363 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.334578 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.334680 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.334901 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.334989 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.335229 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.335318 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.335539 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.335637 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.335845 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.335942 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.336151 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.336240 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.336489 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.336591 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.336784 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.336890 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.337094 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.337218 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.337429 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.337528 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.337740 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.337829 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.338051 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.338176 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.338363 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.338474 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.338673 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.338764 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.338980 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.339069 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.339302 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.339393 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.339603 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.339701 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.339912 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.340002 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.340227 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.340434 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.340546 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.340759 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.340849 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.341071 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.341192 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.341404 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.341494 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.341711 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.341813 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.342020 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.342297 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.342397 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.342621 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.342711 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.342926 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.343025 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.343232 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.343322 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.343536 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.343625 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.343848 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.343944 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.344162 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.344252 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.344475 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.344566 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.344792 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.344891 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.345102 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.345223 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.345443 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.345534 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.345752 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.345842 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.346063 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.346152 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.346402 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.346526 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.346722 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.346839 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.347025 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.347126 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.347337 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.347462 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.347646 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.347744 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.347956 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.348102 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.348262 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.348419 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.348568 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.348706 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.348865 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.349002 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.349199 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.349294 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.349500 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.349614 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.349805 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.349894 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.350118 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.350208 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.350426 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.350528 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.350757 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.350848 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.351074 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.351163 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.351386 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.351474 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.351695 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.351793 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.352004 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.352093 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.352315 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.352402 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.352645 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.352826 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.352980 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.353143 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.353326 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.353487 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.353642 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.353806 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.353956 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.354116 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.354270 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.354428 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.354742 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.354843 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.355066 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.355155 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.355371 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.355460 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.355672 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.355768 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.355979 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.356075 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.356282 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.356430 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.356582 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.356672 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.356901 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.357002 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.357223 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.357316 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.357525 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.357616 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.357838 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.357927 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.358144 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.358233 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.358510 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.358668 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.358835 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.359009 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.359149 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.359321 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.359457 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.359644 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.359779 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.359959 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.360089 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.360278 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.360580 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.360676 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.360897 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.360985 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.361216 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.361320 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.361520 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.361608 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.361829 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.361924 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.362135 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.362225 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.362436 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.362523 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.362736 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.362825 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.363042 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.363139 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.363346 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.363434 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.363645 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.363733 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.363949 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.364037 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.364246 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.364333 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.364567 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.364654 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.364870 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.364959 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.365190 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.365283 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.365489 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.365590 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.365798 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.365884 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.366096 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.366182 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.366907 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.367031 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.367214 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.367324 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.367514 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.367610 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.367819 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.368032 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.368126 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.368347 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.368443 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.368692 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.368785 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.368953 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.369760 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.369851 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.369922 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.370006 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.370092 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.370164 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.370233 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.370437 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.370766 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.371071 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.371373 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.371687 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.371801 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.371994 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.372137 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.372314 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.372472 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.372620 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.372799 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.372926 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.373127 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.373510 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.373852 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.374172 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.374490 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.374858 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.374957 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.375146 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.375251 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.375477 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.375696 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.375785 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.376044 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.376142 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.376377 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.376467 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.376722 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.376811 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.377065 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.377309 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.377402 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.377658 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.377747 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.377989 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.378078 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.378318 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.378409 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.378631 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.378739 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.378945 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.379053 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.379255 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.379345 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.379567 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.379656 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.379876 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.379981 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.380184 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.380273 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.380493 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.380590 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.380806 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.380905 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.381113 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.381221 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.381442 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.381542 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.381749 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.381852 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.382629 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.382724 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.382940 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.383028 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.383252 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.383343 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.383562 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.383651 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.383876 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.383965 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.384190 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.384280 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.384500 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.384587 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.384811 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.384902 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.385118 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.385229 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.385449 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.385538 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.385755 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.385911 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.386061 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.386160 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.386627 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.386717 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.386952 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.387067 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.387264 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.387366 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.387561 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.387650 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.387875 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.387976 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.388196 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.388286 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.388531 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.388623 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.388850 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.388991 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.389177 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.389327 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.389500 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.389590 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.389819 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.389910 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.390127 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.390222 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.390447 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.390538 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.390757 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.390848 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.391084 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.391178 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.391418 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.391521 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.391739 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.391829 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.392059 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.392155 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.392363 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.392460 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.392665 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.392761 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.392965 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.393054 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.393292 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.393399 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.393608 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.393699 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.393911 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.394000 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.394210 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.394301 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.394509 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.394604 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.394813 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.394908 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.395111 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.395202 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.395409 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.395498 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.395707 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.395796 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.396004 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.396095 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.396306 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.396402 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.396601 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.396698 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.396900 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.396991 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.397226 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.397378 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.397527 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.397629 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.397851 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.398064 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.398153 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.398386 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.398679 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.398781 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.398989 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.399178 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.399295 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.399491 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.399603 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.399795 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.399911 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.400101 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.400224 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.400402 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.400531 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.400736 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.400833 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.401066 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.401193 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.401415 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.401522 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.401735 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.401825 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.402041 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.402129 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.402399 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.402510 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.402664 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.402762 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.402981 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.403070 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.403298 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.403396 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.403609 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.403699 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.403913 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.404001 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.404235 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.404332 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.404539 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.404636 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.404846 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.404936 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.405205 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.405300 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.405480 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.405578 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.405786 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.405876 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.406093 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.406183 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.406408 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.406496 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.406721 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.406817 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.407022 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.407111 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.407330 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.407419 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.407643 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.407754 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.407958 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.408047 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.408269 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.408357 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.408575 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.408674 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.408898 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.408987 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.409225 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.409324 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.409530 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.409637 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.409843 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.409933 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.410149 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.410288 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.410455 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.410553 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.410771 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.410859 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.411081 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.411213 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.411390 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.411488 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.411701 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.411790 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.412008 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.412096 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.412325 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.412414 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.412644 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.412739 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.412971 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.413058 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.413334 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.413441 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.413668 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.413760 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.413988 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.414086 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.414300 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.414390 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.414609 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.414698 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.414910 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.415079 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.415166 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 14:30:22.415297 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.415615 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.415931 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.416240 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:30:22.416484 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 14:30:22.476251 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO dbcounter [None req-b6dc4604-138b-4867-ae44-732d39772b1c None None] Registered counter for database nova_api Jul 12 14:30:22.477845 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO dbcounter [None req-2c324c0c-11fb-43a1-9117-7b4e446bdc41 None None] Registered counter for database nova_api Jul 12 14:30:22.589245 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG oslo_db.sqlalchemy.engines [None req-b6dc4604-138b-4867-ae44-732d39772b1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:30:22.592732 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG oslo_db.sqlalchemy.engines [None req-2c324c0c-11fb-43a1-9117-7b4e446bdc41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:30:22.595782 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG dbcounter [-] [104582] Writer thread running {{(pid=104582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:30:22.599100 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG dbcounter [-] [104583] Writer thread running {{(pid=104583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:30:22.651165 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.context [None req-b6dc4604-138b-4867-ae44-732d39772b1c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda(cell1) {{(pid=104582) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 14:30:22.654418 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.context [None req-2c324c0c-11fb-43a1-9117-7b4e446bdc41 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda(cell1) {{(pid=104583) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 14:30:22.655119 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG oslo_concurrency.lockutils [None req-b6dc4604-138b-4867-ae44-732d39772b1c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:30:22.656716 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG oslo_concurrency.lockutils [None req-b6dc4604-138b-4867-ae44-732d39772b1c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:30:22.657540 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG oslo_concurrency.lockutils [None req-b6dc4604-138b-4867-ae44-732d39772b1c None None] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:30:22.658257 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG oslo_concurrency.lockutils [None req-2c324c0c-11fb-43a1-9117-7b4e446bdc41 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:30:22.659611 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG oslo_concurrency.lockutils [None req-b6dc4604-138b-4867-ae44-732d39772b1c None None] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:30:22.659835 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG oslo_concurrency.lockutils [None req-2c324c0c-11fb-43a1-9117-7b4e446bdc41 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:30:22.660617 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG oslo_concurrency.lockutils [None req-2c324c0c-11fb-43a1-9117-7b4e446bdc41 None None] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:30:22.661581 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO dbcounter [None req-b6dc4604-138b-4867-ae44-732d39772b1c None None] Registered counter for database nova_cell0 Jul 12 14:30:22.662712 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG oslo_concurrency.lockutils [None req-2c324c0c-11fb-43a1-9117-7b4e446bdc41 None None] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:30:22.665305 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO dbcounter [None req-2c324c0c-11fb-43a1-9117-7b4e446bdc41 None None] Registered counter for database nova_cell0 Jul 12 14:30:22.665889 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO dbcounter [None req-b6dc4604-138b-4867-ae44-732d39772b1c None None] Registered counter for database nova_cell1 Jul 12 14:30:22.669174 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO dbcounter [None req-2c324c0c-11fb-43a1-9117-7b4e446bdc41 None None] Registered counter for database nova_cell1 Jul 12 14:30:22.673382 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG oslo_db.sqlalchemy.engines [None req-b6dc4604-138b-4867-ae44-732d39772b1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:30:22.675724 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG oslo_db.sqlalchemy.engines [None req-b6dc4604-138b-4867-ae44-732d39772b1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:30:22.676956 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG oslo_db.sqlalchemy.engines [None req-2c324c0c-11fb-43a1-9117-7b4e446bdc41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:30:22.679928 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG oslo_db.sqlalchemy.engines [None req-2c324c0c-11fb-43a1-9117-7b4e446bdc41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:30:22.680966 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG dbcounter [-] [104582] Writer thread running {{(pid=104582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:30:22.684116 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG dbcounter [-] [104582] Writer thread running {{(pid=104582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:30:22.686564 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG dbcounter [-] [104583] Writer thread running {{(pid=104583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:30:22.688596 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG dbcounter [-] [104583] Writer thread running {{(pid=104583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:30:22.827910 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO dbcounter [None req-b6dc4604-138b-4867-ae44-732d39772b1c None None] Registered counter for database nova_cell0 Jul 12 14:30:22.832105 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO dbcounter [None req-2c324c0c-11fb-43a1-9117-7b4e446bdc41 None None] Registered counter for database nova_cell0 Jul 12 14:30:22.837430 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG oslo_db.sqlalchemy.engines [None req-b6dc4604-138b-4867-ae44-732d39772b1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:30:22.841120 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG oslo_db.sqlalchemy.engines [None req-2c324c0c-11fb-43a1-9117-7b4e446bdc41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:30:22.842049 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG dbcounter [-] [104582] Writer thread running {{(pid=104582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:30:22.845697 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG dbcounter [-] [104583] Writer thread running {{(pid=104583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:30:23.251269 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: WARNING keystonemiddleware.auth_token [None req-b6dc4604-138b-4867-ae44-732d39772b1c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 14:30:23.258565 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: WARNING keystonemiddleware.auth_token [None req-b6dc4604-138b-4867-ae44-732d39772b1c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 14:30:23.279007 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: WARNING keystonemiddleware.auth_token [None req-2c324c0c-11fb-43a1-9117-7b4e446bdc41 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 14:30:23.286338 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: WARNING keystonemiddleware.auth_token [None req-2c324c0c-11fb-43a1-9117-7b4e446bdc41 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 14:30:23.597378 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: WARNING keystonemiddleware.auth_token [None req-b6dc4604-138b-4867-ae44-732d39772b1c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 14:30:23.603253 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: WARNING keystonemiddleware.auth_token [None req-b6dc4604-138b-4867-ae44-732d39772b1c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 14:30:23.608478 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564b7b0089c0 pid: 104582 (default app) Jul 12 14:30:23.610591 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-b6dc4604-138b-4867-ae44-732d39772b1c None None] Calling method '>' {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:30:23.611781 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-b6dc4604-138b-4867-ae44-732d39772b1c None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001736 Jul 12 14:30:23.612191 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Tue Jul 12 14:30:23 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:30:23.624450 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: WARNING keystonemiddleware.auth_token [None req-2c324c0c-11fb-43a1-9117-7b4e446bdc41 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 14:30:23.630354 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: WARNING keystonemiddleware.auth_token [None req-2c324c0c-11fb-43a1-9117-7b4e446bdc41 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 14:30:23.636098 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564b7b0089c0 pid: 104583 (default app) Jul 12 14:31:42.119679 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-b6dc4604-138b-4867-ae44-732d39772b1c None None] Calling method '>' {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:31:42.121452 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-b6dc4604-138b-4867-ae44-732d39772b1c None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002129 Jul 12 14:31:42.122378 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 930 bytes} [Tue Jul 12 14:31:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:31:42.135104 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG dbcounter [-] [104583] Writing DB stats nova_api:SELECT=3 {{(pid=104583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:31:42.136398 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG dbcounter [-] [104583] Writing DB stats nova_cell0:SELECT=3 {{(pid=104583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:31:42.137376 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG dbcounter [-] [104583] Writing DB stats nova_cell1:SELECT=3 {{(pid=104583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:31:42.138175 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG dbcounter [-] [104583] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:31:43.000180 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-b2bc11a0-96af-4252-b699-b450fef5b274 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:31:43.031047 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-b2bc11a0-96af-4252-b699-b450fef5b274 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.901292 Jul 12 14:31:43.032054 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1291 bytes} [Tue Jul 12 14:31:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:31:45.227408 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-b6dc4604-138b-4867-ae44-732d39772b1c None None] Calling method '>' {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:31:45.228416 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-b6dc4604-138b-4867-ae44-732d39772b1c None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 12 14:31:45.229058 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 3/4] 10.222.0.30 () {54 vars in 930 bytes} [Tue Jul 12 14:31:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:31:45.713394 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-a99c7320-de7c-4638-8923-3240c1bfeaf0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 256, "name": "cirros256", "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:31:45.731642 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:31:45.731642 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: warnings.warn(msg) Jul 12 14:31:45.795607 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-a99c7320-de7c-4638-8923-3240c1bfeaf0 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.560293 Jul 12 14:31:45.803366 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 2/5] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Jul 12 14:31:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:31:45.810636 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG dbcounter [-] [104582] Writing DB stats nova_api:SELECT=3 {{(pid=104582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:31:45.811587 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG dbcounter [-] [104582] Writing DB stats nova_cell0:SELECT=3 {{(pid=104582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:31:45.812427 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG dbcounter [-] [104582] Writing DB stats nova_cell1:SELECT=3 {{(pid=104582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:31:45.813174 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG dbcounter [-] [104582] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:31:46.018932 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-209d1e33-7dcf-401a-bf27-efc1770bcbd6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:31:46.022162 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:31:46.022162 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: warnings.warn(msg) Jul 12 14:31:46.126143 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-209d1e33-7dcf-401a-bf27-efc1770bcbd6 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.321146 Jul 12 14:31:46.126761 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 4/6] 10.222.0.30 () {64 vars in 1335 bytes} [Tue Jul 12 14:31:45 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:31:48.374660 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-a99c7320-de7c-4638-8923-3240c1bfeaf0 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:31:48.376482 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-a99c7320-de7c-4638-8923-3240c1bfeaf0 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jul 12 14:31:48.377049 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 3/7] 10.222.0.30 () {54 vars in 930 bytes} [Tue Jul 12 14:31:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:31:49.036514 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-bd54ee20-35be-461d-99e2-c8efb181fe1e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "d1", "ram": 512, "disk": 5}} {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:31:49.058551 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:31:49.058551 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: warnings.warn(msg) Jul 12 14:31:49.129197 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-bd54ee20-35be-461d-99e2-c8efb181fe1e admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.745379 Jul 12 14:31:49.129888 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 5/8] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Jul 12 14:31:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 14:31:49.143770 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-2113dcba-4ea2-49fc-8651-5359c26d9eca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:31:49.145408 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:31:49.145408 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: warnings.warn(msg) Jul 12 14:31:49.229948 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-2113dcba-4ea2-49fc-8651-5359c26d9eca admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090118 Jul 12 14:31:49.230631 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 4/9] 10.222.0.30 () {64 vars in 1335 bytes} [Tue Jul 12 14:31:49 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:31:51.454466 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-bd54ee20-35be-461d-99e2-c8efb181fe1e admin admin] Calling method '>' {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:31:51.456042 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-bd54ee20-35be-461d-99e2-c8efb181fe1e admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001991 Jul 12 14:31:51.457306 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 930 bytes} [Tue Jul 12 14:31:51 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:31:51.851265 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-20b28838-7c0d-433c-a897-fd0c5c6d2dc2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d2", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0}} {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:31:51.910871 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-20b28838-7c0d-433c-a897-fd0c5c6d2dc2 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.447939 Jul 12 14:31:51.911337 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 5/11] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Jul 12 14:31:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:31:51.923376 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-7bddbad3-4843-4a10-b2a1-a9b2c94da031 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:31:51.999560 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-7bddbad3-4843-4a10-b2a1-a9b2c94da031 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079888 Jul 12 14:31:52.000129 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 7/12] 10.222.0.30 () {64 vars in 1335 bytes} [Tue Jul 12 14:31:51 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:31:54.264189 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-20b28838-7c0d-433c-a897-fd0c5c6d2dc2 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:31:54.265291 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-20b28838-7c0d-433c-a897-fd0c5c6d2dc2 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 12 14:31:54.265696 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 6/13] 10.222.0.30 () {54 vars in 930 bytes} [Tue Jul 12 14:31:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:31:54.741293 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-399a42aa-fce5-4e98-9afb-830bc376228e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "vcpus": 2, "os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "ram": 2048, "swap": 0}} {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:31:54.826029 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-399a42aa-fce5-4e98-9afb-830bc376228e admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.553931 Jul 12 14:31:54.827053 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 8/14] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Jul 12 14:31:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 14:31:54.839462 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-e02f114f-fc06-4cc4-920b-5a13c4ca4b5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:31:54.914976 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-e02f114f-fc06-4cc4-920b-5a13c4ca4b5b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079144 Jul 12 14:31:54.915714 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 7/15] 10.222.0.30 () {64 vars in 1335 bytes} [Tue Jul 12 14:31:54 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:31:57.124968 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-399a42aa-fce5-4e98-9afb-830bc376228e admin admin] Calling method '>' {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:31:57.126001 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-399a42aa-fce5-4e98-9afb-830bc376228e admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 12 14:31:57.126398 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 9/16] 10.222.0.30 () {54 vars in 930 bytes} [Tue Jul 12 14:31:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:31:57.556639 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-d4d59f43-43c0-4cca-9faf-168c37cd83c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "name": "ds4G", "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:31:57.631624 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-d4d59f43-43c0-4cca-9faf-168c37cd83c7 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.498830 Jul 12 14:31:57.632482 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 8/17] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Jul 12 14:31:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:31:57.645104 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-4111dd7d-29a5-43c0-aedc-81b853c11788 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:31:57.708359 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-4111dd7d-29a5-43c0-aedc-81b853c11788 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067377 Jul 12 14:31:57.709000 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 10/18] 10.222.0.30 () {64 vars in 1335 bytes} [Tue Jul 12 14:31:57 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:00.265687 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-d4d59f43-43c0-4cca-9faf-168c37cd83c7 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:00.266883 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-d4d59f43-43c0-4cca-9faf-168c37cd83c7 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 Jul 12 14:32:00.267306 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 9/19] 10.222.0.30 () {54 vars in 930 bytes} [Tue Jul 12 14:32:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:32:00.705015 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-d4adb2d0-b7c5-4ee1-868c-1e1400c834e3 admin admin] Calling method '>' {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:00.729016 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-d4adb2d0-b7c5-4ee1-868c-1e1400c834e3 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.454784 Jul 12 14:32:00.729814 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 11/20] 10.222.0.30 () {60 vars in 1291 bytes} [Tue Jul 12 14:32:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:32:03.056942 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-d4d59f43-43c0-4cca-9faf-168c37cd83c7 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:03.057984 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-d4d59f43-43c0-4cca-9faf-168c37cd83c7 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jul 12 14:32:03.058319 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 10/21] 10.222.0.30 () {54 vars in 930 bytes} [Tue Jul 12 14:32:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:32:03.528837 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-1b3a10f7-f1c3-4d74-a815-8aa001c845e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "1", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny"}} {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:32:03.606663 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-1b3a10f7-f1c3-4d74-a815-8aa001c845e2 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.540082 Jul 12 14:32:03.607226 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 12/22] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Jul 12 14:32:03 2022] POST /compute/v2.1/flavors => generated 402 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:32:03.619626 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-93ca51b2-5bcc-4777-b341-ed933f32bf96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:32:03.703491 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-93ca51b2-5bcc-4777-b341-ed933f32bf96 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087299 Jul 12 14:32:03.704505 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 11/23] 10.222.0.30 () {64 vars in 1332 bytes} [Tue Jul 12 14:32:03 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:32:05.923228 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-1b3a10f7-f1c3-4d74-a815-8aa001c845e2 admin admin] Calling method '>' {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:05.925015 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-1b3a10f7-f1c3-4d74-a815-8aa001c845e2 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jul 12 14:32:05.925203 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 930 bytes} [Tue Jul 12 14:32:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:32:06.316344 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-3f32d7e5-8ca5-4950-a017-c6a7071a7b58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "2", "vcpus": 1, "name": "m1.small", "rxtx_factor": 1.0}} {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:32:06.400894 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-3f32d7e5-8ca5-4950-a017-c6a7071a7b58 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.469758 Jul 12 14:32:06.401507 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 12/25] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Jul 12 14:32:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:32:06.414043 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-f3ef02b0-d10d-4915-99c0-28de188f7c6c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:32:06.508125 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-f3ef02b0-d10d-4915-99c0-28de188f7c6c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097724 Jul 12 14:32:06.508685 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 14/26] 10.222.0.30 () {64 vars in 1332 bytes} [Tue Jul 12 14:32:06 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:08.723724 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-3f32d7e5-8ca5-4950-a017-c6a7071a7b58 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:08.724760 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-3f32d7e5-8ca5-4950-a017-c6a7071a7b58 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 12 14:32:08.725150 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 13/27] 10.222.0.30 () {54 vars in 930 bytes} [Tue Jul 12 14:32:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:32:09.072588 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-39410e28-db62-4493-9cf2-031c64c2dcf8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "ram": 4096, "os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0, "name": "m1.medium", "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:32:09.145087 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-39410e28-db62-4493-9cf2-031c64c2dcf8 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.414069 Jul 12 14:32:09.146087 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 15/28] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Jul 12 14:32:08 2022] POST /compute/v2.1/flavors => generated 406 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:32:09.157955 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-ce77ac2a-1342-48af-855c-4613376b7703 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:32:09.233918 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-ce77ac2a-1342-48af-855c-4613376b7703 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079834 Jul 12 14:32:09.234515 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 14/29] 10.222.0.30 () {64 vars in 1332 bytes} [Tue Jul 12 14:32:09 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:11.501101 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-39410e28-db62-4493-9cf2-031c64c2dcf8 admin admin] Calling method '>' {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:11.502163 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-39410e28-db62-4493-9cf2-031c64c2dcf8 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 12 14:32:11.502715 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 16/30] 10.222.0.30 () {54 vars in 930 bytes} [Tue Jul 12 14:32:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:32:11.976207 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-05a5a819-8c9d-4e7f-9ce4-086bc827c3e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 8192, "rxtx_factor": 1.0, "name": "m1.large", "vcpus": 4, "os-flavor-access:is_public": true, "disk": 80}} {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:32:12.060079 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-05a5a819-8c9d-4e7f-9ce4-086bc827c3e2 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.551754 Jul 12 14:32:12.060566 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 15/31] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Jul 12 14:32:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 14:32:12.073387 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-ac64d21d-9f3a-4563-a20c-9872a5118174 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:32:12.190804 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-ac64d21d-9f3a-4563-a20c-9872a5118174 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120752 Jul 12 14:32:12.191960 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 17/32] 10.222.0.30 () {64 vars in 1332 bytes} [Tue Jul 12 14:32:12 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:14.498389 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-05a5a819-8c9d-4e7f-9ce4-086bc827c3e2 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:14.499332 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-05a5a819-8c9d-4e7f-9ce4-086bc827c3e2 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 12 14:32:14.513296 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 16/33] 10.222.0.30 () {54 vars in 930 bytes} [Tue Jul 12 14:32:14 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:32:14.994978 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-fd55e6e2-7753-4c36-a53c-9350c8fcf86b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "5", "name": "m1.xlarge", "swap": 0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 16384, "vcpus": 8}} {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:32:15.072672 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-fd55e6e2-7753-4c36-a53c-9350c8fcf86b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.566191 Jul 12 14:32:15.073446 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 18/34] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Jul 12 14:32:14 2022] POST /compute/v2.1/flavors => generated 408 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:32:15.087418 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-501d72a2-a3ba-4cf2-9dbc-7b2b1055e85b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:32:15.091311 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG dbcounter [-] [104583] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=104583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:15.198673 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-501d72a2-a3ba-4cf2-9dbc-7b2b1055e85b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117189 Jul 12 14:32:15.202816 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 17/35] 10.222.0.30 () {64 vars in 1332 bytes} [Tue Jul 12 14:32:15 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:35.712215 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-fd55e6e2-7753-4c36-a53c-9350c8fcf86b admin admin] Calling method '>' {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:35.713181 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-fd55e6e2-7753-4c36-a53c-9350c8fcf86b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jul 12 14:32:35.713632 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 19/36] 10.222.0.30 () {54 vars in 930 bytes} [Tue Jul 12 14:32:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:32:36.096492 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-422cb01c-fcfa-4045-a327-d268c7c550de admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:36.113102 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-422cb01c-fcfa-4045-a327-d268c7c550de admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.393744 Jul 12 14:32:36.113658 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1291 bytes} [Tue Jul 12 14:32:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:32:37.166054 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-fd55e6e2-7753-4c36-a53c-9350c8fcf86b admin admin] Calling method '>' {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:37.167059 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-fd55e6e2-7753-4c36-a53c-9350c8fcf86b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jul 12 14:32:37.167456 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 20/38] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Jul 12 14:32:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:32:37.692954 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-62c448fa-a519-493e-a25f-a5d419b4f207 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:37.698594 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.wsgi [None req-62c448fa-a519-493e-a25f-a5d419b4f207 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 12 14:32:37.701905 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-62c448fa-a519-493e-a25f-a5d419b4f207 admin admin] Request method failure captured: Jul 12 14:32:37.701905 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 12 14:32:37.701905 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: Accept: application/json Jul 12 14:32:37.701905 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: Accept-Encoding: gzip, deflate Jul 12 14:32:37.701905 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: Connection: keep-alive Jul 12 14:32:37.701905 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: Content-Length: 0 Jul 12 14:32:37.701905 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: Host: 10.222.0.30 Jul 12 14:32:37.701905 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: Openstack-Api-Version: compute 2.90 Jul 12 14:32:37.701905 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: Openstack-System-Scope: None Jul 12 14:32:37.701905 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: User-Agent: python-novaclient Jul 12 14:32:37.701905 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Auth-Token: gAAAAABizYYFjN7qnM_CGJEnM4K3pdjqYR8Zc4C8e68xtX3jWK-7GdcThhP_UIcSbqelUBfg5Ki6yWYDgePBCBRoLGsdv5MJl-fJ_NUrOU5FyvDQ8g30sw8dSkwdinV-9A5xsw8Us9TNXw3DoOXgDHooJ68qNcHLBQqpKlhaz3jwp_a2egEejvs Jul 12 14:32:37.701905 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Domain-Id: None Jul 12 14:32:37.701905 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Domain-Name: None Jul 12 14:32:37.701905 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Identity-Status: Confirmed Jul 12 14:32:37.701905 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Is-Admin-Project: True Jul 12 14:32:37.701905 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 14:32:37.701905 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Project-Domain-Id: default Jul 12 14:32:37.701905 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Project-Domain-Name: Default Jul 12 14:32:37.701905 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Project-Id: 27c596858f1e4aabb2a1fb3cbe092011 Jul 12 14:32:37.701905 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Project-Name: admin Jul 12 14:32:37.701905 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Role: member,admin,reader Jul 12 14:32:37.701905 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Roles: member,admin,reader Jul 12 14:32:37.703615 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27c596858f1e4aabb2a1fb3cbe092011"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/27c596858f1e4aabb2a1fb3cbe092011"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27c596858f1e4aabb2a1fb3cbe092011"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_27c596858f1e4aabb2a1fb3cbe092011", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:32:37.703615 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Tenant: admin Jul 12 14:32:37.703615 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Tenant-Id: 27c596858f1e4aabb2a1fb3cbe092011 Jul 12 14:32:37.703615 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Tenant-Name: admin Jul 12 14:32:37.703615 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-User: admin Jul 12 14:32:37.703615 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-User-Domain-Id: default Jul 12 14:32:37.703615 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-User-Domain-Name: Default Jul 12 14:32:37.703615 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-User-Id: cb516c8046b14d4c8dffdce40fe28f5d Jul 12 14:32:37.703615 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-User-Name: admin Jul 12 14:32:37.703615 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: method: > Jul 12 14:32:37.703615 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: exception: Flavor 42 could not be found. Jul 12 14:32:37.703615 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: action_args: {'id': '42'} Jul 12 14:32:37.703615 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:32:37.703615 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:37.705185 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 14:32:37.705185 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 14:32:37.705185 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 14:32:37.705185 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 14:32:37.705185 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 14:32:37.705185 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 14:32:37.705185 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 14:32:37.705185 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 14:32:37.705185 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 14:32:37.705185 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:32:37.705185 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 14:32:37.705185 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 14:32:37.705185 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 12 14:32:37.705185 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Jul 12 14:32:37.705185 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:32:37.705185 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Jul 12 14:32:37.705185 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:37.705185 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:32:37.705185 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:32:37.706560 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:32:37.706560 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:32:37.706560 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:32:37.706560 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:32:37.706560 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 14:32:37.706560 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:32:37.706560 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 12 14:32:37.706560 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Jul 12 14:32:37.706560 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:32:37.706560 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Jul 12 14:32:37.706560 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:37.706560 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:32:37.706560 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:32:37.706560 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:32:37.706560 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:32:37.706560 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 12 14:32:37.706560 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Jul 12 14:32:37.706560 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-62c448fa-a519-493e-a25f-a5d419b4f207 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:32:37.707865 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-62c448fa-a519-493e-a25f-a5d419b4f207 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.396935 Jul 12 14:32:37.707865 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Jul 12 14:32:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 14:32:37.713739 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-ddf73c4a-896c-464f-8b49-aed9c294ee93 admin admin] Calling method '>' {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:37.716689 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG dbcounter [-] [104582] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=104582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:37.735665 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-ddf73c4a-896c-464f-8b49-aed9c294ee93 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025502 Jul 12 14:32:37.736171 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 21/40] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Jul 12 14:32:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:32:37.745676 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-96067bd7-ca6b-4dd2-aa2b-4ef551bf8b85 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:37.766734 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-96067bd7-ca6b-4dd2-aa2b-4ef551bf8b85 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024575 Jul 12 14:32:37.767776 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Jul 12 14:32:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:32:37.776903 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-0a2577f6-f645-44cb-b0ba-eacae96456fb admin admin] Calling method '>' {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:37.783413 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.wsgi [None req-0a2577f6-f645-44cb-b0ba-eacae96456fb admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 12 14:32:37.787430 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-0a2577f6-f645-44cb-b0ba-eacae96456fb admin admin] Request method failure captured: Jul 12 14:32:37.787430 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 12 14:32:37.787430 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: Accept: application/json Jul 12 14:32:37.787430 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: Accept-Encoding: gzip, deflate Jul 12 14:32:37.787430 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: Connection: keep-alive Jul 12 14:32:37.787430 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: Content-Length: 0 Jul 12 14:32:37.787430 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: Host: 10.222.0.30 Jul 12 14:32:37.787430 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: Openstack-Api-Version: compute 2.90 Jul 12 14:32:37.787430 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: Openstack-System-Scope: None Jul 12 14:32:37.787430 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: User-Agent: python-novaclient Jul 12 14:32:37.787430 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Auth-Token: gAAAAABizYYFjN7qnM_CGJEnM4K3pdjqYR8Zc4C8e68xtX3jWK-7GdcThhP_UIcSbqelUBfg5Ki6yWYDgePBCBRoLGsdv5MJl-fJ_NUrOU5FyvDQ8g30sw8dSkwdinV-9A5xsw8Us9TNXw3DoOXgDHooJ68qNcHLBQqpKlhaz3jwp_a2egEejvs Jul 12 14:32:37.787430 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Domain-Id: None Jul 12 14:32:37.787430 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Domain-Name: None Jul 12 14:32:37.787430 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Identity-Status: Confirmed Jul 12 14:32:37.787430 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Is-Admin-Project: True Jul 12 14:32:37.787430 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 14:32:37.787430 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Project-Domain-Id: default Jul 12 14:32:37.787430 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Project-Domain-Name: Default Jul 12 14:32:37.787430 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Project-Id: 27c596858f1e4aabb2a1fb3cbe092011 Jul 12 14:32:37.787430 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Project-Name: admin Jul 12 14:32:37.787430 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Role: member,admin,reader Jul 12 14:32:37.787430 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Roles: member,admin,reader Jul 12 14:32:37.795333 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27c596858f1e4aabb2a1fb3cbe092011"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/27c596858f1e4aabb2a1fb3cbe092011"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27c596858f1e4aabb2a1fb3cbe092011"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_27c596858f1e4aabb2a1fb3cbe092011", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:32:37.795333 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Tenant: admin Jul 12 14:32:37.795333 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Tenant-Id: 27c596858f1e4aabb2a1fb3cbe092011 Jul 12 14:32:37.795333 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Tenant-Name: admin Jul 12 14:32:37.795333 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-User: admin Jul 12 14:32:37.795333 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-User-Domain-Id: default Jul 12 14:32:37.795333 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-User-Domain-Name: Default Jul 12 14:32:37.795333 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-User-Id: cb516c8046b14d4c8dffdce40fe28f5d Jul 12 14:32:37.795333 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-User-Name: admin Jul 12 14:32:37.795333 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: method: > Jul 12 14:32:37.795333 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: exception: Flavor 42 could not be found. Jul 12 14:32:37.795333 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: action_args: {'id': '42'} Jul 12 14:32:37.795333 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:32:37.795333 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:37.796821 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 14:32:37.796821 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 14:32:37.796821 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 14:32:37.796821 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 14:32:37.796821 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 14:32:37.796821 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 14:32:37.796821 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 14:32:37.796821 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 14:32:37.796821 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 14:32:37.796821 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:32:37.796821 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 14:32:37.796821 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 14:32:37.796821 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 12 14:32:37.796821 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi Jul 12 14:32:37.796821 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:32:37.796821 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi Jul 12 14:32:37.796821 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:37.796821 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:32:37.796821 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:32:37.798809 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:32:37.798809 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:32:37.798809 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:32:37.798809 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:32:37.798809 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 14:32:37.798809 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:32:37.798809 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 12 14:32:37.798809 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi Jul 12 14:32:37.798809 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:32:37.798809 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi Jul 12 14:32:37.798809 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:37.798809 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:32:37.798809 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:32:37.798809 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:32:37.798809 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:32:37.798809 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 12 14:32:37.798809 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi Jul 12 14:32:37.798809 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-0a2577f6-f645-44cb-b0ba-eacae96456fb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:32:37.800611 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-0a2577f6-f645-44cb-b0ba-eacae96456fb admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015426 Jul 12 14:32:37.800611 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 22/42] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Jul 12 14:32:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 14:32:38.755518 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-96067bd7-ca6b-4dd2-aa2b-4ef551bf8b85 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:38.756530 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-96067bd7-ca6b-4dd2-aa2b-4ef551bf8b85 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jul 12 14:32:38.756941 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 21/43] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Jul 12 14:32:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:32:39.270642 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-6355c533-26c9-40f1-89a4-3df5baedb02b admin admin] Calling method '>' {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:39.276095 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.wsgi [None req-6355c533-26c9-40f1-89a4-3df5baedb02b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 12 14:32:39.277682 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-6355c533-26c9-40f1-89a4-3df5baedb02b admin admin] Request method failure captured: Jul 12 14:32:39.277682 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 12 14:32:39.277682 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: Accept: application/json Jul 12 14:32:39.277682 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: Accept-Encoding: gzip, deflate Jul 12 14:32:39.277682 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: Connection: keep-alive Jul 12 14:32:39.277682 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: Content-Length: 0 Jul 12 14:32:39.277682 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: Host: 10.222.0.30 Jul 12 14:32:39.277682 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: Openstack-Api-Version: compute 2.90 Jul 12 14:32:39.277682 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: Openstack-System-Scope: None Jul 12 14:32:39.277682 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: User-Agent: python-novaclient Jul 12 14:32:39.277682 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Auth-Token: gAAAAABizYYGWqLbkS-06N7B_o1VD93AISEl9_QX9O24a2clVJeYXRr5og3AGii12z1cjf1ybe51Gk6huqOorwzf64Nbasq9fL0DusHMBcV1QibOssUlznEoaGtM8zxwG1M9ekgnu2sOeg0gYLWKGU749wEn0jQK5XYmY099o92_yg1ETlLuP40 Jul 12 14:32:39.277682 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Domain-Id: None Jul 12 14:32:39.277682 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Domain-Name: None Jul 12 14:32:39.277682 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Identity-Status: Confirmed Jul 12 14:32:39.277682 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Is-Admin-Project: True Jul 12 14:32:39.277682 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 14:32:39.277682 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Project-Domain-Id: default Jul 12 14:32:39.277682 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Project-Domain-Name: Default Jul 12 14:32:39.277682 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Project-Id: 27c596858f1e4aabb2a1fb3cbe092011 Jul 12 14:32:39.277682 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Project-Name: admin Jul 12 14:32:39.277682 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Role: member,admin,reader Jul 12 14:32:39.277682 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Roles: member,admin,reader Jul 12 14:32:39.279369 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27c596858f1e4aabb2a1fb3cbe092011"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/27c596858f1e4aabb2a1fb3cbe092011"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27c596858f1e4aabb2a1fb3cbe092011"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_27c596858f1e4aabb2a1fb3cbe092011", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:32:39.279369 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Tenant: admin Jul 12 14:32:39.279369 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Tenant-Id: 27c596858f1e4aabb2a1fb3cbe092011 Jul 12 14:32:39.279369 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Tenant-Name: admin Jul 12 14:32:39.279369 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-User: admin Jul 12 14:32:39.279369 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-User-Domain-Id: default Jul 12 14:32:39.279369 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-User-Domain-Name: Default Jul 12 14:32:39.279369 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-User-Id: cb516c8046b14d4c8dffdce40fe28f5d Jul 12 14:32:39.279369 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-User-Name: admin Jul 12 14:32:39.279369 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: method: > Jul 12 14:32:39.279369 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: exception: Flavor 84 could not be found. Jul 12 14:32:39.279369 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: action_args: {'id': '84'} Jul 12 14:32:39.279369 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:32:39.279369 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:39.280489 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 14:32:39.280489 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 14:32:39.280489 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 14:32:39.280489 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 14:32:39.280489 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 14:32:39.280489 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 14:32:39.280489 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 14:32:39.280489 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 14:32:39.280489 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 14:32:39.280489 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:32:39.280489 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 14:32:39.280489 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 14:32:39.280489 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 12 14:32:39.280489 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi Jul 12 14:32:39.280489 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:32:39.280489 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi Jul 12 14:32:39.280489 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:39.280489 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:32:39.280489 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:32:39.282154 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:32:39.282154 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:32:39.282154 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:32:39.282154 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:32:39.282154 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 14:32:39.282154 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:32:39.282154 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 12 14:32:39.282154 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi Jul 12 14:32:39.282154 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:32:39.282154 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi Jul 12 14:32:39.282154 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:39.282154 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:32:39.282154 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:32:39.282154 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:32:39.282154 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:32:39.282154 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 12 14:32:39.282154 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi Jul 12 14:32:39.282154 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-6355c533-26c9-40f1-89a4-3df5baedb02b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:32:39.284050 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-6355c533-26c9-40f1-89a4-3df5baedb02b admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.385116 Jul 12 14:32:39.284050 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 23/44] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Jul 12 14:32:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 14:32:39.289499 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-9db1a325-a465-4025-a8e1-9ef128f4d697 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:39.302782 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-9db1a325-a465-4025-a8e1-9ef128f4d697 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016782 Jul 12 14:32:39.303288 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Jul 12 14:32:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:32:39.312153 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-03c0c147-507b-450d-b875-48ed8309aeaa admin admin] Calling method '>' {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:39.326488 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-03c0c147-507b-450d-b875-48ed8309aeaa admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017726 Jul 12 14:32:39.327010 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Jul 12 14:32:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:32:39.336371 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-d7ad9352-c1d9-4a14-b07b-692f2fe65cc0 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:39.341560 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.wsgi [None req-d7ad9352-c1d9-4a14-b07b-692f2fe65cc0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 12 14:32:39.343045 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-d7ad9352-c1d9-4a14-b07b-692f2fe65cc0 admin admin] Request method failure captured: Jul 12 14:32:39.343045 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 12 14:32:39.343045 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: Accept: application/json Jul 12 14:32:39.343045 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: Accept-Encoding: gzip, deflate Jul 12 14:32:39.343045 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: Connection: keep-alive Jul 12 14:32:39.343045 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: Content-Length: 0 Jul 12 14:32:39.343045 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: Host: 10.222.0.30 Jul 12 14:32:39.343045 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: Openstack-Api-Version: compute 2.90 Jul 12 14:32:39.343045 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: Openstack-System-Scope: None Jul 12 14:32:39.343045 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: User-Agent: python-novaclient Jul 12 14:32:39.343045 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Auth-Token: gAAAAABizYYGWqLbkS-06N7B_o1VD93AISEl9_QX9O24a2clVJeYXRr5og3AGii12z1cjf1ybe51Gk6huqOorwzf64Nbasq9fL0DusHMBcV1QibOssUlznEoaGtM8zxwG1M9ekgnu2sOeg0gYLWKGU749wEn0jQK5XYmY099o92_yg1ETlLuP40 Jul 12 14:32:39.343045 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Domain-Id: None Jul 12 14:32:39.343045 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Domain-Name: None Jul 12 14:32:39.343045 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Identity-Status: Confirmed Jul 12 14:32:39.343045 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Is-Admin-Project: True Jul 12 14:32:39.343045 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 14:32:39.343045 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Project-Domain-Id: default Jul 12 14:32:39.343045 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Project-Domain-Name: Default Jul 12 14:32:39.343045 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Project-Id: 27c596858f1e4aabb2a1fb3cbe092011 Jul 12 14:32:39.343045 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Project-Name: admin Jul 12 14:32:39.343045 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Role: member,admin,reader Jul 12 14:32:39.343045 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Roles: member,admin,reader Jul 12 14:32:39.344611 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27c596858f1e4aabb2a1fb3cbe092011"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/27c596858f1e4aabb2a1fb3cbe092011"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27c596858f1e4aabb2a1fb3cbe092011"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_27c596858f1e4aabb2a1fb3cbe092011", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:32:39.344611 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Tenant: admin Jul 12 14:32:39.344611 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Tenant-Id: 27c596858f1e4aabb2a1fb3cbe092011 Jul 12 14:32:39.344611 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Tenant-Name: admin Jul 12 14:32:39.344611 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-User: admin Jul 12 14:32:39.344611 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-User-Domain-Id: default Jul 12 14:32:39.344611 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-User-Domain-Name: Default Jul 12 14:32:39.344611 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-User-Id: cb516c8046b14d4c8dffdce40fe28f5d Jul 12 14:32:39.344611 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-User-Name: admin Jul 12 14:32:39.344611 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: method: > Jul 12 14:32:39.344611 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: exception: Flavor 84 could not be found. Jul 12 14:32:39.344611 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: action_args: {'id': '84'} Jul 12 14:32:39.344611 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:32:39.344611 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:39.346106 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 14:32:39.346106 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 14:32:39.346106 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 14:32:39.346106 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 14:32:39.346106 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 14:32:39.346106 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 14:32:39.346106 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 14:32:39.346106 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 14:32:39.346106 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 14:32:39.346106 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:32:39.346106 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 14:32:39.346106 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 14:32:39.346106 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 12 14:32:39.346106 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Jul 12 14:32:39.346106 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:32:39.346106 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Jul 12 14:32:39.346106 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:39.346106 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:32:39.346106 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:32:39.347388 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:32:39.347388 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:32:39.347388 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:32:39.347388 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:32:39.347388 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 14:32:39.347388 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:32:39.347388 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 12 14:32:39.347388 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Jul 12 14:32:39.347388 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:32:39.347388 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Jul 12 14:32:39.347388 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:39.347388 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:32:39.347388 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:32:39.347388 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:32:39.347388 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:32:39.347388 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 12 14:32:39.347388 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Jul 12 14:32:39.347388 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-d7ad9352-c1d9-4a14-b07b-692f2fe65cc0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:32:39.348637 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-d7ad9352-c1d9-4a14-b07b-692f2fe65cc0 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011446 Jul 12 14:32:39.348637 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 23/47] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Jul 12 14:32:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 12 14:32:40.307410 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-03c0c147-507b-450d-b875-48ed8309aeaa admin admin] Calling method '>' {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:40.308408 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-03c0c147-507b-450d-b875-48ed8309aeaa admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jul 12 14:32:40.308794 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 25/48] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Jul 12 14:32:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:32:40.823088 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-88d52424-8875-4ae1-b94d-e7f172d5a953 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:40.828737 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.wsgi [None req-88d52424-8875-4ae1-b94d-e7f172d5a953 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 12 14:32:40.830752 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-88d52424-8875-4ae1-b94d-e7f172d5a953 admin admin] Request method failure captured: Jul 12 14:32:40.830752 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 12 14:32:40.830752 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: Accept: application/json Jul 12 14:32:40.830752 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: Accept-Encoding: gzip, deflate Jul 12 14:32:40.830752 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: Connection: keep-alive Jul 12 14:32:40.830752 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: Content-Length: 0 Jul 12 14:32:40.830752 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: Host: 10.222.0.30 Jul 12 14:32:40.830752 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: Openstack-Api-Version: compute 2.90 Jul 12 14:32:40.830752 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: Openstack-System-Scope: None Jul 12 14:32:40.830752 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: User-Agent: python-novaclient Jul 12 14:32:40.830752 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Auth-Token: gAAAAABizYYI-ui33WabFAmCoZmGHWeoCEnyvHq6eRfdZw7hz4vjKL7ekb8X-MzIMoEf7XJbGCRS_LRWDqsk5hTsGJbJMBN5NZCkibjRk9weA43T2UskiUjNN6MXf_BEwCb8oIqHvMz58_UUDb_TMYD1CWDYMIE0SL6G6eu4s8owLB0LgjXhyC4 Jul 12 14:32:40.830752 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Domain-Id: None Jul 12 14:32:40.830752 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Domain-Name: None Jul 12 14:32:40.830752 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Identity-Status: Confirmed Jul 12 14:32:40.830752 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Is-Admin-Project: True Jul 12 14:32:40.830752 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 14:32:40.830752 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Project-Domain-Id: default Jul 12 14:32:40.830752 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Project-Domain-Name: Default Jul 12 14:32:40.830752 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Project-Id: 27c596858f1e4aabb2a1fb3cbe092011 Jul 12 14:32:40.830752 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Project-Name: admin Jul 12 14:32:40.830752 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Role: member,admin,reader Jul 12 14:32:40.830752 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Roles: member,admin,reader Jul 12 14:32:40.832279 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27c596858f1e4aabb2a1fb3cbe092011"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/27c596858f1e4aabb2a1fb3cbe092011"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27c596858f1e4aabb2a1fb3cbe092011"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_27c596858f1e4aabb2a1fb3cbe092011", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:32:40.832279 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Tenant: admin Jul 12 14:32:40.832279 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Tenant-Id: 27c596858f1e4aabb2a1fb3cbe092011 Jul 12 14:32:40.832279 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-Tenant-Name: admin Jul 12 14:32:40.832279 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-User: admin Jul 12 14:32:40.832279 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-User-Domain-Id: default Jul 12 14:32:40.832279 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-User-Domain-Name: Default Jul 12 14:32:40.832279 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-User-Id: cb516c8046b14d4c8dffdce40fe28f5d Jul 12 14:32:40.832279 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: X-User-Name: admin Jul 12 14:32:40.832279 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: method: > Jul 12 14:32:40.832279 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: exception: Flavor 451 could not be found. Jul 12 14:32:40.832279 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: action_args: {'id': '451'} Jul 12 14:32:40.832279 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:32:40.832279 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:40.833297 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 14:32:40.833297 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 14:32:40.833297 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 14:32:40.833297 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 14:32:40.833297 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 14:32:40.833297 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 14:32:40.833297 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 14:32:40.833297 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 14:32:40.833297 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 14:32:40.833297 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:32:40.833297 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 14:32:40.833297 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 14:32:40.833297 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 12 14:32:40.833297 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Jul 12 14:32:40.833297 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:32:40.833297 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Jul 12 14:32:40.833297 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:40.833297 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:32:40.833297 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:32:40.834636 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:32:40.834636 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:32:40.834636 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:32:40.834636 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:32:40.834636 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 14:32:40.834636 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:32:40.834636 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 12 14:32:40.834636 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Jul 12 14:32:40.834636 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:32:40.834636 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Jul 12 14:32:40.834636 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:40.834636 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:32:40.834636 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:32:40.834636 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:32:40.834636 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:32:40.834636 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 12 14:32:40.834636 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Jul 12 14:32:40.834636 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-88d52424-8875-4ae1-b94d-e7f172d5a953 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:32:40.835881 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-88d52424-8875-4ae1-b94d-e7f172d5a953 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.386966 Jul 12 14:32:40.835881 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 24/49] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Jul 12 14:32:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 14:32:40.841531 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-f3247c7c-2340-4332-9035-03e1023940fe admin admin] Calling method '>' {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:40.855660 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-f3247c7c-2340-4332-9035-03e1023940fe admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017642 Jul 12 14:32:40.856169 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 26/50] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Jul 12 14:32:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:32:40.865058 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-4a2c882e-c8ce-498b-ae28-5a0df615f095 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:40.879720 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-4a2c882e-c8ce-498b-ae28-5a0df615f095 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018112 Jul 12 14:32:40.880254 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 25/51] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Jul 12 14:32:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:32:40.894846 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-2f01ef97-7f61-4c26-ac30-9fadf223a427 admin admin] Calling method '>' {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:40.900183 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.wsgi [None req-2f01ef97-7f61-4c26-ac30-9fadf223a427 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 12 14:32:40.901701 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-2f01ef97-7f61-4c26-ac30-9fadf223a427 admin admin] Request method failure captured: Jul 12 14:32:40.901701 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 12 14:32:40.901701 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: Accept: application/json Jul 12 14:32:40.901701 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: Accept-Encoding: gzip, deflate Jul 12 14:32:40.901701 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: Connection: keep-alive Jul 12 14:32:40.901701 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: Content-Length: 0 Jul 12 14:32:40.901701 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: Host: 10.222.0.30 Jul 12 14:32:40.901701 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: Openstack-Api-Version: compute 2.90 Jul 12 14:32:40.901701 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: Openstack-System-Scope: None Jul 12 14:32:40.901701 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: User-Agent: python-novaclient Jul 12 14:32:40.901701 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Auth-Token: gAAAAABizYYI-ui33WabFAmCoZmGHWeoCEnyvHq6eRfdZw7hz4vjKL7ekb8X-MzIMoEf7XJbGCRS_LRWDqsk5hTsGJbJMBN5NZCkibjRk9weA43T2UskiUjNN6MXf_BEwCb8oIqHvMz58_UUDb_TMYD1CWDYMIE0SL6G6eu4s8owLB0LgjXhyC4 Jul 12 14:32:40.901701 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Domain-Id: None Jul 12 14:32:40.901701 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Domain-Name: None Jul 12 14:32:40.901701 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Identity-Status: Confirmed Jul 12 14:32:40.901701 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Is-Admin-Project: True Jul 12 14:32:40.901701 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 14:32:40.901701 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Project-Domain-Id: default Jul 12 14:32:40.901701 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Project-Domain-Name: Default Jul 12 14:32:40.901701 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Project-Id: 27c596858f1e4aabb2a1fb3cbe092011 Jul 12 14:32:40.901701 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Project-Name: admin Jul 12 14:32:40.901701 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Role: member,admin,reader Jul 12 14:32:40.901701 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Roles: member,admin,reader Jul 12 14:32:40.903265 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27c596858f1e4aabb2a1fb3cbe092011"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/27c596858f1e4aabb2a1fb3cbe092011"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27c596858f1e4aabb2a1fb3cbe092011"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_27c596858f1e4aabb2a1fb3cbe092011", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:32:40.903265 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Tenant: admin Jul 12 14:32:40.903265 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Tenant-Id: 27c596858f1e4aabb2a1fb3cbe092011 Jul 12 14:32:40.903265 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-Tenant-Name: admin Jul 12 14:32:40.903265 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-User: admin Jul 12 14:32:40.903265 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-User-Domain-Id: default Jul 12 14:32:40.903265 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-User-Domain-Name: Default Jul 12 14:32:40.903265 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-User-Id: cb516c8046b14d4c8dffdce40fe28f5d Jul 12 14:32:40.903265 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: X-User-Name: admin Jul 12 14:32:40.903265 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: method: > Jul 12 14:32:40.903265 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: exception: Flavor 451 could not be found. Jul 12 14:32:40.903265 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: action_args: {'id': '451'} Jul 12 14:32:40.903265 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:32:40.903265 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:40.904349 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 14:32:40.904349 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 14:32:40.904349 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 14:32:40.904349 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 14:32:40.904349 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 14:32:40.904349 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 14:32:40.904349 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 14:32:40.904349 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 14:32:40.904349 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 14:32:40.904349 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:32:40.904349 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 14:32:40.904349 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 14:32:40.904349 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 12 14:32:40.904349 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi Jul 12 14:32:40.904349 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:32:40.904349 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi Jul 12 14:32:40.904349 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:40.904349 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:32:40.904349 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:32:40.905766 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:32:40.905766 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:32:40.905766 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:32:40.905766 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:32:40.905766 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 14:32:40.905766 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:32:40.905766 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 12 14:32:40.905766 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi Jul 12 14:32:40.905766 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:32:40.905766 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi Jul 12 14:32:40.905766 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:40.905766 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:32:40.905766 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:32:40.905766 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:32:40.905766 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:32:40.905766 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 12 14:32:40.905766 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: ERROR nova.api.openstack.wsgi Jul 12 14:32:40.905766 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-2f01ef97-7f61-4c26-ac30-9fadf223a427 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:32:40.907003 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-2f01ef97-7f61-4c26-ac30-9fadf223a427 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012618 Jul 12 14:32:40.907003 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 27/52] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Jul 12 14:32:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 14:32:41.859156 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-4a2c882e-c8ce-498b-ae28-5a0df615f095 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:41.860166 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-4a2c882e-c8ce-498b-ae28-5a0df615f095 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jul 12 14:32:41.861197 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 26/53] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Jul 12 14:32:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:32:42.397517 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-76af368e-f093-430d-a58e-d8c34a59d352 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:32:42.474578 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-76af368e-f093-430d-a58e-d8c34a59d352 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.476409 Jul 12 14:32:42.475129 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 28/54] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Jul 12 14:32:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 14:32:43.452372 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-4a2c882e-c8ce-498b-ae28-5a0df615f095 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:43.453396 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-4a2c882e-c8ce-498b-ae28-5a0df615f095 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 12 14:32:43.453788 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Jul 12 14:32:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:32:43.981724 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-f57dbf97-28e0-4cbe-8eeb-a866aad2673f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:32:44.097039 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-f57dbf97-28e0-4cbe-8eeb-a866aad2673f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.504076 Jul 12 14:32:44.097631 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 29/56] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Jul 12 14:32:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:32:45.082434 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-4a2c882e-c8ce-498b-ae28-5a0df615f095 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:45.083442 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-4a2c882e-c8ce-498b-ae28-5a0df615f095 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jul 12 14:32:45.083831 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 28/57] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Jul 12 14:32:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:32:45.601996 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-3dbdcf6f-734f-400f-9dd1-2a0e405401e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:32:45.684705 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-3dbdcf6f-734f-400f-9dd1-2a0e405401e3 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.462758 Jul 12 14:32:45.685273 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 30/58] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Jul 12 14:32:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:32:46.640670 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-4a2c882e-c8ce-498b-ae28-5a0df615f095 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:46.641739 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-4a2c882e-c8ce-498b-ae28-5a0df615f095 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 12 14:32:46.642129 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 29/59] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Jul 12 14:32:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:32:47.151608 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-450b00c9-1d36-4993-9845-a90fc7a16a43 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:32:47.241179 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-450b00c9-1d36-4993-9845-a90fc7a16a43 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.463353 Jul 12 14:32:47.241710 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 31/60] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Jul 12 14:32:46 2022] POST /compute/v2.1/flavors => generated 409 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:32:48.218763 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-4a2c882e-c8ce-498b-ae28-5a0df615f095 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:48.219796 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-4a2c882e-c8ce-498b-ae28-5a0df615f095 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 12 14:32:48.220216 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 30/61] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Jul 12 14:32:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:32:48.740468 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-bad2f0e7-2467-46e7-a172-5134f6874bb3 admin admin] Calling method '>' {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:48.759739 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-bad2f0e7-2467-46e7-a172-5134f6874bb3 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.402830 Jul 12 14:32:48.760531 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 32/62] 10.222.0.30 () {60 vars in 1202 bytes} [Tue Jul 12 14:32:48 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:33:40.662162 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-4a2c882e-c8ce-498b-ae28-5a0df615f095 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:40.663187 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-4a2c882e-c8ce-498b-ae28-5a0df615f095 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jul 12 14:33:40.663579 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 31/63] 10.222.0.30 () {54 vars in 930 bytes} [Tue Jul 12 14:33:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:33:40.674023 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG dbcounter [-] [104582] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:41.045078 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-3cc3a94f-769f-4595-821d-91b38f3d1190 admin admin] Calling method '>' {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:41.064220 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-3cc3a94f-769f-4595-821d-91b38f3d1190 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.394789 Jul 12 14:33:41.064755 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 33/64] 10.222.0.30 () {60 vars in 1291 bytes} [Tue Jul 12 14:33:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:33:41.085755 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG dbcounter [-] [104583] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=104583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:41.089391 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-31edcf18-0613-4c45-9726-737c72ed8af0 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:41.097051 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-31edcf18-0613-4c45-9726-737c72ed8af0 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012662 Jul 12 14:33:41.097597 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 32/65] 10.222.0.30 () {60 vars in 1282 bytes} [Tue Jul 12 14:33:41 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:41.108876 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-35cf1a1c-fb6f-4b40-8559-67142e306efe admin admin] Calling method '>' {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:41.116467 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-35cf1a1c-fb6f-4b40-8559-67142e306efe admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011234 Jul 12 14:33:41.116977 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 34/66] 10.222.0.30 () {60 vars in 1285 bytes} [Tue Jul 12 14:33:41 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:41.128884 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-98ffbb21-7116-4580-8e50-abb2c5f29c0c admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:41.136546 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-98ffbb21-7116-4580-8e50-abb2c5f29c0c admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011456 Jul 12 14:33:41.137064 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1285 bytes} [Tue Jul 12 14:33:41 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:41.148512 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-09892aca-a53f-44a4-94ae-c247710c836a admin admin] Calling method '>' {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:41.155981 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-09892aca-a53f-44a4-94ae-c247710c836a admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010885 Jul 12 14:33:41.156486 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1282 bytes} [Tue Jul 12 14:33:41 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:37:17.910597 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-98ffbb21-7116-4580-8e50-abb2c5f29c0c admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:17.911782 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-98ffbb21-7116-4580-8e50-abb2c5f29c0c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001578 Jul 12 14:37:17.912205 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 34/69] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Jul 12 14:37:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:37:18.054888 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG dbcounter [-] [104582] Writing DB stats nova_api:SELECT=6 {{(pid=104582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:37:18.217501 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-29bc3b55-e65b-4ad7-9cfc-b1a4b3a68559 admin admin] Calling method '>' {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:18.218754 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:37:18.218754 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: warnings.warn(msg) Jul 12 14:37:18.219988 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG oslo_concurrency.lockutils [None req-29bc3b55-e65b-4ad7-9cfc-b1a4b3a68559 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:18.220436 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG oslo_concurrency.lockutils [None req-29bc3b55-e65b-4ad7-9cfc-b1a4b3a68559 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:18.221301 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG oslo_concurrency.lockutils [None req-29bc3b55-e65b-4ad7-9cfc-b1a4b3a68559 admin admin] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:18.221740 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG oslo_concurrency.lockutils [None req-29bc3b55-e65b-4ad7-9cfc-b1a4b3a68559 admin admin] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:18.255637 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-29bc3b55-e65b-4ad7-9cfc-b1a4b3a68559 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.202181 Jul 12 14:37:18.256187 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 36/70] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Jul 12 14:37:18 2022] GET /compute/v2.1/os-services => generated 794 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:37:19.077579 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-98ffbb21-7116-4580-8e50-abb2c5f29c0c admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:19.078618 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-98ffbb21-7116-4580-8e50-abb2c5f29c0c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jul 12 14:37:19.079010 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 35/71] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Jul 12 14:37:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:37:19.273290 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-aa4067c4-4de3-4b2f-b43a-fdc8d86e0535 admin admin] Calling method '>' {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:19.274459 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:37:19.274459 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: warnings.warn(msg) Jul 12 14:37:19.275646 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG oslo_concurrency.lockutils [None req-aa4067c4-4de3-4b2f-b43a-fdc8d86e0535 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:19.276090 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG oslo_concurrency.lockutils [None req-aa4067c4-4de3-4b2f-b43a-fdc8d86e0535 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:19.276876 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG oslo_concurrency.lockutils [None req-aa4067c4-4de3-4b2f-b43a-fdc8d86e0535 admin admin] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:19.277372 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG oslo_concurrency.lockutils [None req-aa4067c4-4de3-4b2f-b43a-fdc8d86e0535 admin admin] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:19.296559 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-aa4067c4-4de3-4b2f-b43a-fdc8d86e0535 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.074461 Jul 12 14:37:19.297047 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 37/72] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Jul 12 14:37:19 2022] GET /compute/v2.1/os-services => generated 794 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 14:37:30.567223 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-98ffbb21-7116-4580-8e50-abb2c5f29c0c admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:30.568355 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-98ffbb21-7116-4580-8e50-abb2c5f29c0c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Jul 12 14:37:30.568829 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 36/73] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Jul 12 14:37:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:37:30.712759 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG dbcounter [-] [104582] Writing DB stats nova_cell0:SELECT=4 {{(pid=104582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:37:30.713554 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG dbcounter [-] [104582] Writing DB stats nova_cell1:SELECT=4 {{(pid=104582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:37:30.714174 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG dbcounter [-] [104582] Writing DB stats nova_api:SELECT=8 {{(pid=104582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:37:30.762842 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-8ed64dd1-71ee-4f79-9cd2-27be9b51a738 admin admin] Calling method '>' {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:30.764061 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:37:30.764061 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: warnings.warn(msg) Jul 12 14:37:30.765275 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG oslo_concurrency.lockutils [None req-8ed64dd1-71ee-4f79-9cd2-27be9b51a738 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:30.765718 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG oslo_concurrency.lockutils [None req-8ed64dd1-71ee-4f79-9cd2-27be9b51a738 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:30.766506 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG oslo_concurrency.lockutils [None req-8ed64dd1-71ee-4f79-9cd2-27be9b51a738 admin admin] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:30.767582 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG oslo_concurrency.lockutils [None req-8ed64dd1-71ee-4f79-9cd2-27be9b51a738 admin admin] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:30.792460 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-8ed64dd1-71ee-4f79-9cd2-27be9b51a738 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.084170 Jul 12 14:37:30.793018 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 38/74] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Jul 12 14:37:30 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:37:31.622783 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-98ffbb21-7116-4580-8e50-abb2c5f29c0c admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:31.623792 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-98ffbb21-7116-4580-8e50-abb2c5f29c0c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jul 12 14:37:31.624185 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 37/75] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Jul 12 14:37:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:37:31.816318 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG nova.api.openstack.wsgi [None req-a9361d83-2e4e-443e-bfba-9452cecd95ff admin admin] Calling method '>' {{(pid=104582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:31.817516 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:37:31.817516 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: warnings.warn(msg) Jul 12 14:37:31.818695 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG oslo_concurrency.lockutils [None req-a9361d83-2e4e-443e-bfba-9452cecd95ff admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:31.819138 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG oslo_concurrency.lockutils [None req-a9361d83-2e4e-443e-bfba-9452cecd95ff admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:31.819934 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG oslo_concurrency.lockutils [None req-a9361d83-2e4e-443e-bfba-9452cecd95ff admin admin] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:31.820364 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: DEBUG oslo_concurrency.lockutils [None req-a9361d83-2e4e-443e-bfba-9452cecd95ff admin admin] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:31.842029 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: INFO nova.api.openstack.requestlog [None req-a9361d83-2e4e-443e-bfba-9452cecd95ff admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.078624 Jul 12 14:37:31.842509 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: [pid: 104582|app: 0|req: 39/76] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Jul 12 14:37:31 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:26.722221 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: Tue Jul 12 14:38:26 2022 - graceful shutdown triggered... Jul 12 14:38:26.721975 dv-cinder-820027-12-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 12 14:38:26.723178 dv-cinder-820027-12-iscsi devstack@n-api.service[104582]: Gracefully killing worker 1 (pid: 104582)... Jul 12 14:38:26.723577 dv-cinder-820027-12-iscsi devstack@n-api.service[104583]: Gracefully killing worker 2 (pid: 104583)... Jul 12 14:38:27.723063 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: worker 1 buried after 1 seconds Jul 12 14:38:27.723063 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: worker 2 buried after 1 seconds Jul 12 14:38:27.723063 dv-cinder-820027-12-iscsi devstack@n-api.service[104581]: goodbye to uWSGI. Jul 12 14:38:27.724598 dv-cinder-820027-12-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 12 14:38:27.725188 dv-cinder-820027-12-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 12 14:38:27.727991 dv-cinder-820027-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 12 14:38:27.737146 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 12 14:38:27.739308 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 14:38:27 2022] *** Jul 12 14:38:27.739308 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 14:38:27.739308 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 14:38:27.739308 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: nodename: dv-cinder-820027-12-iscsi Jul 12 14:38:27.739308 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: machine: x86_64 Jul 12 14:38:27.739308 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: clock source: unix Jul 12 14:38:27.739308 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: pcre jit disabled Jul 12 14:38:27.739308 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: detected number of CPU cores: 4 Jul 12 14:38:27.739308 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: current working directory: / Jul 12 14:38:27.739308 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: detected binary path: /usr/bin/uwsgi-core Jul 12 14:38:27.740041 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: your processes number limit is 47680 Jul 12 14:38:27.740041 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: your memory page size is 4096 bytes Jul 12 14:38:27.740041 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: detected max file descriptor number: 2048 Jul 12 14:38:27.740041 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: lock engine: pthread robust mutexes Jul 12 14:38:27.740041 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: thunder lock: enabled Jul 12 14:38:27.740041 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 12 14:38:27.740041 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 14:38:27.784114 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: Python main interpreter initialized at 0x563afcae39c0 Jul 12 14:38:27.784114 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: python threads support enabled Jul 12 14:38:27.784114 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: your server socket listen backlog is limited to 100 connections Jul 12 14:38:27.784114 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: your mercy for graceful operations on workers is 90 seconds Jul 12 14:38:27.784573 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 14:38:27.784573 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: *** Operational MODE: preforking *** Jul 12 14:38:27.784833 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: *** uWSGI is running in multiple interpreter mode *** Jul 12 14:38:27.784833 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: spawned uWSGI master process (pid: 129964) Jul 12 14:38:27.785041 dv-cinder-820027-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 12 14:38:27.785650 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: spawned uWSGI worker 1 (pid: 129980, cores: 1) Jul 12 14:38:27.786143 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: spawned uWSGI worker 2 (pid: 129981, cores: 1) Jul 12 14:38:27.786426 dv-cinder-820027-12-iscsi devstack@n-api.service[129964]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 14:38:28.446940 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 14:38:28.457358 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 14:38:29.645775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 14:38:29.645775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: from cryptography.utils import int_from_bytes Jul 12 14:38:29.646510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 14:38:29.646510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: from cryptography.utils import int_from_bytes Jul 12 14:38:29.647593 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 14:38:29.647593 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: from cryptography.utils import int_from_bytes Jul 12 14:38:29.647593 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 14:38:29.647593 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: from cryptography.utils import int_from_bytes Jul 12 14:38:31.993846 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 14:38:31.994507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 14:38:31.994786 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 14:38:31.995002 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 14:38:31.995332 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 14:38:31.995713 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:31.996038 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:31.996359 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:31.996676 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:31.997002 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:31.997100 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 14:38:31.997843 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 14:38:31.997935 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:31.997935 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:31.998101 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 14:38:31.998193 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:31.998279 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 14:38:31.998566 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:31.998678 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 14:38:31.998779 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:31.998866 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:31.999041 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:31.999204 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:31.999309 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-12-iscsi {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:31.999506 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:31.999624 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:31.999832 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:31.999946 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.000167 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.000278 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.000492 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.000655 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.000816 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.000972 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.001419 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.001571 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.001804 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.001976 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.001976 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.004088 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.004364 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.004601 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.004835 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-12-iscsi {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.005062 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.005315 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.005564 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.005790 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.006052 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.006286 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.006501 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.006712 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.006924 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.007146 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.007375 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.007596 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.007807 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.008020 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.008245 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.008468 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.008713 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.008927 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.009146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-12-iscsi {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.009403 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.009602 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.009797 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.009985 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.010143 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.010336 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.010555 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.010731 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.010893 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.011100 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.011260 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.011416 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.012200 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.012366 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.012562 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.012721 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.012876 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.013034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.013234 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-12-iscsi {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.013390 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.013549 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.013706 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.013866 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.014028 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.014177 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.014331 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.014480 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.014648 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.014808 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.014970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.015200 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.015354 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.015513 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.015668 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.015823 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.015995 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.016144 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.016299 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.016465 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.016613 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.016768 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.016916 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.017075 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.017255 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.017414 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.017561 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.017722 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.017928 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.017928 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.018243 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.018400 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.018566 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.018714 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.018870 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.019028 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.019186 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.019333 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.019491 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.019491 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.019802 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.019959 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.020113 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.020268 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.020424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.020583 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.020740 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.020740 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.021019 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.021019 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.021344 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.021503 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.022344 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.022517 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.022681 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.022880 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.023035 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.023183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.023330 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.023485 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.023641 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.023799 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.023963 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.024119 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.024306 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.024594 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.024759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.024948 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.025108 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.025358 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.025509 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.025657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.025814 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.025962 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.026110 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.026263 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.026417 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.026589 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.026751 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.026901 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.027058 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.027213 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.027368 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.027523 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.027683 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.027832 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.027987 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.028136 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.028289 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.028462 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.028624 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.028624 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.028906 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.029052 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.029218 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.029383 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.029532 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.029700 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.029857 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.030012 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.030168 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.030331 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.030499 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.030647 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.030802 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.030949 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.031104 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.031266 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.031429 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.031577 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.031734 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.032552 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.032721 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.032886 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.033036 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.033225 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.033381 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.033538 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.033700 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.033857 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.034012 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.034161 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.034316 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.034475 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.034731 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.034894 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.035043 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.035192 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.035358 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.035514 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.035746 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.035903 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.036051 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.036205 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.036355 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.036512 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.036667 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.036815 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.036961 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.037120 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.037310 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.037479 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.037627 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.037782 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.037940 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.038107 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.038256 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.038410 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.038572 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.038720 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.038881 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.039029 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.039176 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.039340 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.039489 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.039653 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.039816 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.039971 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.040126 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.040288 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.040438 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.040592 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.040740 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.040895 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.041044 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.041285 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.041452 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.041602 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.041758 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.041907 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.042531 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.042892 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.043058 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.043208 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.043364 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.043512 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.043671 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.043819 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.043975 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.044140 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.044290 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.044436 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.044593 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.044833 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.044997 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.045168 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.045341 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.045498 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.045660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.045809 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.045958 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.046106 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.046265 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.046412 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.046569 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.046718 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.046873 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.047021 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.047169 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.047325 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.047482 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.047637 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.047934 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.048109 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.048270 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.048431 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.048587 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.048791 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.048946 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.049093 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.049779 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.050011 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.050165 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:38:32.050312 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.050459 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.050615 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.050770 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.050940 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.051089 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.051243 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.051400 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.051548 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.051704 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.051855 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.052011 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.052167 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.052758 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.053096 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.053383 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.053548 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.053697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.053852 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.054011 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.054173 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.054321 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.054478 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.054626 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.054781 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.055015 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.055170 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.055325 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.055483 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.057994 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.058171 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.058329 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.058479 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.058641 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.058806 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.058962 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.059111 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.059265 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.059414 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.059621 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.059782 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.059972 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.060138 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.060138 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.060419 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.060419 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.060722 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.060722 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.061009 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.061174 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.061339 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.061502 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.061651 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.061806 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.061972 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.062129 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.062458 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.063057 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.063413 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.063564 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.063712 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.063860 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.064023 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.064173 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.064346 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.064581 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.064735 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.065638 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.065812 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.065963 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.066111 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.066266 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.066429 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.066586 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.066749 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.066897 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.067052 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.067207 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.067355 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.067502 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.067749 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.067972 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.068156 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.068308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.068456 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.068619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.068769 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.068926 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.069083 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.069275 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.069427 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.069583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.069747 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.069910 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.070066 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.070213 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.070360 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.070521 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.070678 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.070833 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.070988 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.071144 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.071299 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.071462 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.071611 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.071757 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.071917 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.072072 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.072221 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.072377 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.072645 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.073229 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.073486 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.073747 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.073914 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.074091 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.074091 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.074533 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.074706 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.074889 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.075158 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.075326 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.075476 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.075642 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.075858 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.076011 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.076175 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.076324 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.076471 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.076618 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.076767 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.076942 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.077099 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.077296 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.077457 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.077605 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.077762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.077920 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.078076 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.078232 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.078387 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.078543 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.078699 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.078857 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.079016 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.079165 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.079313 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.079468 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.079626 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.079793 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.079949 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.080105 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.080259 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.080419 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.080583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.080740 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.080899 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.081046 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.081275 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.081440 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.081602 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.081751 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.081898 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.082053 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.082208 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.082357 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.082513 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.082755 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.083266 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.083437 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.083699 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.083950 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.084115 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.084115 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.084408 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.084557 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.084712 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.084870 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.085020 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.085192 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.085348 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.085508 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.085677 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.085853 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.086081 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.086081 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.086381 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.086538 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.086695 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.086862 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.087058 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.087219 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.087375 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.087523 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.087672 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.087843 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.087991 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.088147 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.088304 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.088460 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.088617 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.088774 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.088922 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.089112 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.089284 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.089433 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.089593 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.089753 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.089911 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.090070 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.090219 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.090219 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.090529 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.090684 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.090846 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.091000 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.091154 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.091307 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.091469 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.091633 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.091801 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.091962 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.092125 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.092286 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.092454 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.092608 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.092781 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.093023 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.093539 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.093728 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.093998 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.094251 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.094414 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.094591 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.094748 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.094991 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.095173 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.095337 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.095493 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.095655 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.095817 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.095982 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.096221 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.096382 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.096544 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.096699 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.096865 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.097029 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.097213 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.097386 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.097551 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.097717 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.097887 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.098049 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.098206 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.098359 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.098522 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.098676 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.098841 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.099007 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.099170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.099332 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.099487 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.099648 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.099894 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.100052 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.100215 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.100369 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.100524 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.100677 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.100841 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.101003 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.101210 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.101373 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.101529 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.101692 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.101863 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.102019 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.102019 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.102333 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.102488 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.102663 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.102827 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.103013 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.103588 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.103588 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.103916 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.104187 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.104456 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.104630 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.104795 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.104950 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.105104 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.105316 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.105474 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.105628 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.105628 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.105953 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.106108 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.106357 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.106520 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.106683 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.106838 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.106992 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.107154 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.107310 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.107472 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.107634 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.107796 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.107959 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.108139 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.108295 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.108449 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.108613 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.108767 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.108927 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.109090 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.109281 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.109447 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.109611 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.109770 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.109925 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.110090 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.110090 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.110412 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.110566 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.110722 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.110889 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.111044 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.111197 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.111351 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.111513 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.112174 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.112343 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.112498 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.112659 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.112832 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.112987 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.113141 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.113752 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.113924 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.114118 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.114375 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.114633 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.114803 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.114970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.115128 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.115282 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.115451 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.115606 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.115770 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.115944 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.116100 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.116260 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.116498 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.116667 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.116833 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.116989 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.117144 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.117382 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.117547 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.117722 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.117892 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.118048 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.118210 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.118371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.118534 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.118534 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.118836 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.118997 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.119159 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.119159 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.119453 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.119629 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.119797 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.119958 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.119958 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.119958 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.120425 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.120592 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.120592 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.120896 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.121050 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.121255 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.121423 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.121587 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.121742 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.121906 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.122074 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.122239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.122393 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.122547 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.122700 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.122854 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.123017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.123173 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.123327 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.123883 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.124055 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.124278 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.124547 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.124805 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.124974 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.124974 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.125307 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.125474 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.125639 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.125810 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.125974 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.126382 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.126382 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.126816 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.126986 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.127150 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.127900 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.128069 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.128232 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.128537 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.128702 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.128858 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.129013 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.129214 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.129388 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.129568 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.129735 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.129904 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.130069 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.130227 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.130389 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.130552 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.130708 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.130863 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.131072 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.131230 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.131392 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.131555 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.131711 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.131885 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.132054 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.132247 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.132407 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.132562 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.132718 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.132873 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.133048 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.133234 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.133234 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.133571 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.134107 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.134351 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.134541 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.134810 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.134810 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.135199 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.135363 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.135529 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.135691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.135855 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.136011 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.136165 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.136319 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.136484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.137494 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.137670 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.137843 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.138009 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.138167 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.138323 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.138835 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.139011 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.139176 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.139341 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.139506 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.139506 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.139845 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.140031 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.140274 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.140457 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.140616 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.140771 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.140941 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.141099 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.141320 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.141490 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.141646 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.141807 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.141972 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.142145 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.142301 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.142464 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.142628 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.142792 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.142989 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.143155 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.143321 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.143476 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.143632 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.144191 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.144375 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.144532 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.144705 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.144974 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.145438 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.145621 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.145781 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.145944 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.146110 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.146273 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.146439 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.146609 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.146766 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.146937 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.147190 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.147351 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.147517 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.147682 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.147839 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.148106 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.148289 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.148449 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.148605 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.148785 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.149017 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.149195 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.149358 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.149762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.149943 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.150110 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.150110 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.150417 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.150574 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.150714 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.151083 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.151249 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.151407 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.151564 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.151663 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.151810 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.151918 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.152015 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.152151 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.152257 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.152354 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.152450 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.152548 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.152645 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.152741 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.152830 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.152917 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.153013 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.153145 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.153255 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.153356 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.153447 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.153542 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.153641 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.153730 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.153826 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.154010 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.154268 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.154371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.154472 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.154570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.154660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.154747 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.154841 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.154930 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.155047 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.155137 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.155225 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.155320 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.155432 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.155529 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.155633 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.155729 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.155825 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.155913 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.156001 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.156105 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.156203 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.156299 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.156388 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.156474 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.156569 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.156740 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.156833 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.156920 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.157015 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.157110 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.157408 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.157517 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.157610 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.157697 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.157784 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.157879 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.157976 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.158078 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.158168 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.158254 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.158254 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.158422 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.159066 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.159173 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.159271 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.159361 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.159449 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.159544 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.159642 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.159740 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.159842 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.159932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.160026 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.160120 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.160217 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.160313 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.160409 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.160498 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.160591 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.160687 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.160785 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.160875 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.160968 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.161064 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.161167 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.161322 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.161428 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.161518 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.161605 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.161700 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.161795 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.161897 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.162006 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.162104 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.162202 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.162298 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.162387 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.162484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.162573 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.162661 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.162746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.162833 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.162833 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.163009 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.163099 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.163193 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.163288 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.163383 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.163485 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.163574 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.163661 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.163755 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.163843 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.163937 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.164035 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.164167 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.164317 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.164442 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.164546 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.164635 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.164733 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.164861 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.164956 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.165043 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.165138 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.165284 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.165389 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.165519 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.165615 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.165712 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.165801 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.165903 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.166039 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.166135 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.166223 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.166310 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.166397 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.166493 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.166583 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.166677 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.166766 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.166852 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.166946 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.167044 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.167133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.167220 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.167329 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.167542 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.167650 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.167750 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.167840 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.167986 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.168083 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.168170 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.168267 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.168363 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.168452 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.168547 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.168646 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.168735 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.168830 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.168919 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.169015 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.169105 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.169209 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.169299 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.169403 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.169493 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.169588 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.169676 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.169770 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.169865 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.169962 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.170055 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.170151 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.170239 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.170326 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.170422 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.170511 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.170598 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.170685 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.170685 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.170852 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.171026 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.171124 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.171221 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.171309 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.171309 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.171550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.171641 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.171728 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.171825 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.171929 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.172028 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.172117 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.172212 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.172302 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.172395 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.172490 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.172596 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.172685 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.172781 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.172781 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.172781 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.172781 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.172781 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.173284 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.173377 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.173477 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.173574 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.173676 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.173772 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.173860 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.173953 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.174049 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.174163 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.174991 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.175116 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.175207 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.175301 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.175397 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.175485 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.175631 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.175735 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.175835 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.175924 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.176012 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.176140 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.176251 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.176348 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.176436 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.176523 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.176523 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.176695 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.176831 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.176943 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.177033 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.177128 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.177278 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.177385 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.177542 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.177733 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.177854 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.177971 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.178086 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.178254 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.178375 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.178498 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.178612 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.178726 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.178839 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.178963 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.179086 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.179202 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.179324 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.179448 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.179582 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.179709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.179832 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.179949 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.180070 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.180189 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.180318 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.180435 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.180549 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.180682 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.180887 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.181026 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.181172 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.181295 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.181409 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.181523 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.181651 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.181791 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.181895 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.181986 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.182072 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.182072 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.182248 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.182349 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.182446 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.182541 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.182637 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.182732 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.182815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.182898 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.182980 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.183067 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.183154 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.183246 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.183343 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.183439 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.183528 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.183620 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.183709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.183795 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.183888 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.183988 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.184084 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.184178 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.184266 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.184352 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.184436 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.184517 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.184612 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.184707 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.184794 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.184887 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.185026 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.185210 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.185325 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.185403 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.185485 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.185560 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.185647 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.185647 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.185781 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.185862 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.185936 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.185936 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.186075 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.186150 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.186223 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.186295 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.186375 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.186458 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.186533 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.186533 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.186671 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.186753 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.186753 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.186906 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.186987 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.187068 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.187068 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.187200 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.187272 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.187356 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.187430 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.187503 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.187503 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.187503 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.187503 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.187503 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.187838 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.187912 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.187984 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.188058 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.188142 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.188239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.188335 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.188424 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.188517 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.188600 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.188683 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.188771 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.188858 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.188945 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.189038 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.189133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.189249 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.189327 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.189407 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.189502 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.189590 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.189773 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.189868 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.189963 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.190062 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.190151 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.190237 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.190335 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.190424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.190517 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.190605 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.190692 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.190777 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.190872 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.190967 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.191069 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.191157 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.191250 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.191346 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.191346 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.191522 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.191661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.191758 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.191846 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.191947 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.192036 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.192131 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.192226 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.192322 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.192410 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.192510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.192599 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.192685 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.192771 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.192859 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.192953 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.193050 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.193145 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.193272 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.193359 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.193446 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.193555 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.193653 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.193748 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.193836 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.193836 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.194000 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.194098 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.194193 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.194281 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.194367 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.194452 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.194592 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.194700 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.194790 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.194877 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.194977 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.195217 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.195363 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.195462 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.195549 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.195764 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.195860 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.196084 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.196189 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.196391 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.196496 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.196699 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.196839 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.197001 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.197099 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.197340 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.197437 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.197648 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.197752 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.197952 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.198049 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.198265 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.198361 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.198570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.198665 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.198885 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.199098 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.199201 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.199449 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.199553 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.199765 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.199863 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.200106 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.200243 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.200415 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.200523 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.200733 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.200831 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.201039 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.201135 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.201385 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.201613 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.201759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.201984 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.202174 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.202297 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.202516 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.202611 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.202850 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.202947 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.203181 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.203275 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.203487 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.203591 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.203794 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.203897 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.204096 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.204194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.204402 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.204510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.204705 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.204799 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.205031 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.205132 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.205455 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.205563 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.205704 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.205800 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.206015 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.206111 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.206327 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.206434 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.206629 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.206725 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.206959 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.207100 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.207277 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.207389 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.207628 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.207814 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.207929 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.208170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.208290 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.208492 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.208596 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.208810 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.208913 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.209118 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.209325 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.209477 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.209586 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.209793 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.209897 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.210121 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.210229 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.210434 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.210528 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.210745 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.210839 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.211070 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.211165 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.211386 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.211490 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.211695 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.211806 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.212010 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.212169 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.212328 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.212472 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.212624 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.212787 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.212940 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.213082 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.213294 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.213390 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.213543 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.213790 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.213901 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.214124 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.214220 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.214443 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.214539 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.214759 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.214855 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.215074 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.215233 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.215498 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.215619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.215793 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.215884 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.215979 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.216075 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.216274 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.216372 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.216583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.216688 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.216888 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.216993 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.217266 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.217359 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.217516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.217624 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.217825 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.217930 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.218129 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.218233 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.218434 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.218541 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.218741 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.218837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.219048 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.219154 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.219355 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.219451 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.219662 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.219771 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.219970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.220099 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.220276 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.220389 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.220586 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.220690 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.220902 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.221540 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.221763 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.221866 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.222089 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.222207 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.222404 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.222507 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.222721 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.222944 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.223038 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.223285 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.223388 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.223612 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.223706 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.223920 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.224022 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.224236 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.224340 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.224565 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.224667 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.224888 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.225070 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.225284 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.225382 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.225591 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.225695 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.225908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.226020 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.226224 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.226328 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.226538 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.226638 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.226845 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.226937 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.227163 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.227363 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.227472 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.227570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.227776 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.227882 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.228089 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.228184 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.228395 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.228497 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.228707 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.228816 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.229021 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.229118 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.229363 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.229468 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.229747 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.229865 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.229990 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.230085 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.230293 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.230391 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.230597 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.230701 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.230905 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.231060 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.231222 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.231327 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.231531 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.231635 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.231834 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.231937 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.232201 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.232318 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.232441 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.232538 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.232743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.232838 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.233045 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.233140 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.233447 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.233546 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.233752 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.233849 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.234060 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.234170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.234360 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.234502 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.234665 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.234824 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.234974 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.235150 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.235275 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.235477 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.235575 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.235866 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.235974 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.236109 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.236214 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.236439 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.236545 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.237296 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.237417 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.237604 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.237710 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.237908 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.238004 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.238210 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.238320 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.238541 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.238639 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.238874 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.238977 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.239237 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.239504 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.239617 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.239841 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.239965 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.240150 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.240265 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.240466 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.240571 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.240776 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.240878 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.241099 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.241252 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.241435 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.241538 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.241746 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.241850 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.242054 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.242168 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.242361 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.242463 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.242670 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.242780 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.242982 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.243095 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.243290 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.243399 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.243600 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.243703 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.243908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.244020 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.244213 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.244323 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.244520 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.244621 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.244828 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.244939 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.245139 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.245273 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.245469 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.245572 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.245846 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.245954 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.246139 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.246314 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.246472 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.246632 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.246797 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.246942 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.247086 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.247241 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.247386 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.247557 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.247657 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.247754 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.247889 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.247985 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.248201 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.248315 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.248512 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.248616 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.248828 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.248924 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.249142 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.249267 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.249488 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.249591 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.249813 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.249925 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.250125 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.250244 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.250462 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.250605 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.250763 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.250886 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.251362 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.251505 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.251679 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.251822 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.251996 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.252099 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.252336 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.252461 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.252655 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.252777 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.252964 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.253068 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.253297 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.253397 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.253543 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 14:38:32.253641 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.253948 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.254262 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.254594 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.254916 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.255243 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.255564 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.255885 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.256224 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.256541 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.256858 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.257196 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.257528 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.257839 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.258158 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.258480 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.258917 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.259229 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.259547 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.259880 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.260211 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.260621 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.260891 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.261276 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.261617 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.261942 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.262261 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.262578 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:38:32.262831 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 14:38:32.406455 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO dbcounter [None req-b69d635d-40f9-4d65-85d9-9893158d4602 None None] Registered counter for database nova_api Jul 12 14:38:32.415829 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO dbcounter [None req-5f9171e0-6f27-4013-9ec5-33b0901f1117 None None] Registered counter for database nova_api Jul 12 14:38:32.427356 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_db.sqlalchemy.engines [None req-b69d635d-40f9-4d65-85d9-9893158d4602 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129981) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:38:32.434832 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writer thread running {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:38:32.436785 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_db.sqlalchemy.engines [None req-5f9171e0-6f27-4013-9ec5-33b0901f1117 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129980) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:38:32.447588 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writer thread running {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:38:32.492846 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.context [None req-b69d635d-40f9-4d65-85d9-9893158d4602 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda(cell1) {{(pid=129981) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 14:38:32.496898 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b69d635d-40f9-4d65-85d9-9893158d4602 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:32.504661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b69d635d-40f9-4d65-85d9-9893158d4602 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:32.504661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b69d635d-40f9-4d65-85d9-9893158d4602 None None] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:32.504661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b69d635d-40f9-4d65-85d9-9893158d4602 None None] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:32.504661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO dbcounter [None req-b69d635d-40f9-4d65-85d9-9893158d4602 None None] Registered counter for database nova_cell0 Jul 12 14:38:32.504992 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.context [None req-5f9171e0-6f27-4013-9ec5-33b0901f1117 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda(cell1) {{(pid=129980) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 14:38:32.507730 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO dbcounter [None req-b69d635d-40f9-4d65-85d9-9893158d4602 None None] Registered counter for database nova_cell1 Jul 12 14:38:32.508722 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5f9171e0-6f27-4013-9ec5-33b0901f1117 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:32.510343 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5f9171e0-6f27-4013-9ec5-33b0901f1117 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:32.511191 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5f9171e0-6f27-4013-9ec5-33b0901f1117 None None] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:32.513288 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5f9171e0-6f27-4013-9ec5-33b0901f1117 None None] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:32.515050 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_db.sqlalchemy.engines [None req-b69d635d-40f9-4d65-85d9-9893158d4602 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129981) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:38:32.515384 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO dbcounter [None req-5f9171e0-6f27-4013-9ec5-33b0901f1117 None None] Registered counter for database nova_cell0 Jul 12 14:38:32.517527 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_db.sqlalchemy.engines [None req-b69d635d-40f9-4d65-85d9-9893158d4602 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129981) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:38:32.520015 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO dbcounter [None req-5f9171e0-6f27-4013-9ec5-33b0901f1117 None None] Registered counter for database nova_cell1 Jul 12 14:38:32.523128 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writer thread running {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:38:32.527301 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_db.sqlalchemy.engines [None req-5f9171e0-6f27-4013-9ec5-33b0901f1117 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129980) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:38:32.528644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writer thread running {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:38:32.529619 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_db.sqlalchemy.engines [None req-5f9171e0-6f27-4013-9ec5-33b0901f1117 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129980) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:38:32.537787 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writer thread running {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:38:32.538133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writer thread running {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:38:32.672007 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO dbcounter [None req-b69d635d-40f9-4d65-85d9-9893158d4602 None None] Registered counter for database nova_cell0 Jul 12 14:38:32.678713 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_db.sqlalchemy.engines [None req-b69d635d-40f9-4d65-85d9-9893158d4602 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129981) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:38:32.683299 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writer thread running {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:38:32.688641 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO dbcounter [None req-5f9171e0-6f27-4013-9ec5-33b0901f1117 None None] Registered counter for database nova_cell0 Jul 12 14:38:32.695963 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_db.sqlalchemy.engines [None req-5f9171e0-6f27-4013-9ec5-33b0901f1117 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129980) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:38:32.704101 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writer thread running {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:38:33.007974 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: WARNING keystonemiddleware.auth_token [None req-b69d635d-40f9-4d65-85d9-9893158d4602 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 14:38:33.015345 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: WARNING keystonemiddleware.auth_token [None req-b69d635d-40f9-4d65-85d9-9893158d4602 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 14:38:33.031184 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: WARNING keystonemiddleware.auth_token [None req-5f9171e0-6f27-4013-9ec5-33b0901f1117 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 14:38:33.039636 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: WARNING keystonemiddleware.auth_token [None req-5f9171e0-6f27-4013-9ec5-33b0901f1117 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 14:38:33.356391 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: WARNING keystonemiddleware.auth_token [None req-b69d635d-40f9-4d65-85d9-9893158d4602 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 14:38:33.362909 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: WARNING keystonemiddleware.auth_token [None req-b69d635d-40f9-4d65-85d9-9893158d4602 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 14:38:33.368165 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563afcae39c0 pid: 129981 (default app) Jul 12 14:38:33.382735 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: WARNING keystonemiddleware.auth_token [None req-5f9171e0-6f27-4013-9ec5-33b0901f1117 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 14:38:33.388710 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: WARNING keystonemiddleware.auth_token [None req-5f9171e0-6f27-4013-9ec5-33b0901f1117 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 14:38:33.394404 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563afcae39c0 pid: 129980 (default app) Jul 12 14:39:15.321304 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_api:SELECT=3 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:15.331062 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell0:SELECT=3 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:15.331062 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=3 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:15.331062 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell0:SELECT=3 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:15.538128 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_api:SELECT=3 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:15.552740 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=3 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:15.554284 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell0:SELECT=3 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:15.555498 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell0:SELECT=3 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:16.571323 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-341e5c10-3b7d-41f5-b5ff-52854dd2de0b tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] Action: 'create', calling method: .version_select at 0x7f962ea335e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1966713958", "metadata": {"Type": "work"}}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:16.604516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-341e5c10-3b7d-41f5-b5ff-52854dd2de0b tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] Request method failure captured: Jul 12 14:39:16.604516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 14:39:16.604516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:39:16.604516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:39:16.604516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:39:16.604516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 122 Jul 12 14:39:16.604516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:39:16.604516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:39:16.604516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:39:16.604516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:16.604516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYeTFS_jCG-sM6gJ7_3imFPlI4yrbm6rUIU-fezi3k63DHQkeuM0He5Fy_L5_s-x0Rf7RYHxle9fKQfhmenxGATOR19fSpGY0yucU17R-cAecQAxHbewhxE1XmTJJ-OXH9pjdjVb6TKnDSt4B5LE5q4yqVtM0kaJ7Ql9krpIGUilK0c Jul 12 14:39:16.604516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:39:16.604516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:39:16.604516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:39:16.604516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:39:16.604516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:39:16.604516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:39:16.604516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: 91e67f47a1ee45689cd5a315ce580ecb Jul 12 14:39:16.604516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-VolumesNegativeTest-171858805 Jul 12 14:39:16.604516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:39:16.604516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:39:16.606500 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/91e67f47a1ee45689cd5a315ce580ecb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/91e67f47a1ee45689cd5a315ce580ecb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/91e67f47a1ee45689cd5a315ce580ecb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_91e67f47a1ee45689cd5a315ce580ecb", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:39:16.606500 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-VolumesNegativeTest-171858805 Jul 12 14:39:16.606500 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: 91e67f47a1ee45689cd5a315ce580ecb Jul 12 14:39:16.606500 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-VolumesNegativeTest-171858805 Jul 12 14:39:16.606500 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-VolumesNegativeTest-171858805-project Jul 12 14:39:16.606500 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:39:16.606500 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:39:16.606500 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: 326ecee0e4a445feb9f39335afc4c21c Jul 12 14:39:16.606500 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-VolumesNegativeTest-171858805-project Jul 12 14:39:16.606500 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Jul 12 14:39:16.606500 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1966713958", "metadata": {"Type": "work"}}} Jul 12 14:39:16.606500 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: Jul 12 14:39:16.606500 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 14:39:16.607507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1966713958', 'metadata': {'Type': 'work'}}}} Jul 12 14:39:16.607507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:16.607507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:16.607507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 14:39:16.607507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 14:39:16.607507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 14:39:16.607507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise error Jul 12 14:39:16.607507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 12 14:39:16.607507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:16.607507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 12 14:39:16.607507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 14:39:16.607507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:16.607507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 14:39:16.607507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi '#$%' Jul 12 14:39:16.607507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:16.607507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:16.607507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:16.607507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:16.607507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:16.607507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:16.607507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:16.607507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:16.609289 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 14:39:16.609289 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 14:39:16.609289 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:16.609289 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:16.609289 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 14:39:16.609289 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 14:39:16.609289 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 14:39:16.609289 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 14:39:16.609289 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 14:39:16.609289 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 14:39:16.609289 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 14:39:16.609289 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:16.609289 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:16.609289 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:16.609289 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:16.609289 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:16.609289 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:16.609289 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 14:39:16.609289 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 14:39:16.610730 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 14:39:16.610730 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:16.612242 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-341e5c10-3b7d-41f5-b5ff-52854dd2de0b tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:16.614742 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-341e5c10-3b7d-41f5-b5ff-52854dd2de0b tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.309596 Jul 12 14:39:16.615928 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 1/1] 10.222.0.30 () {60 vars in 1155 bytes} [Tue Jul 12 14:39:15 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1312 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 14:39:16.626647 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c2471fa3-2480-40d1-91ae-17eb1d9c5a4c tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] Action: 'create', calling method: .version_select at 0x7f962e9b99d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1473859756", "metadata": {"Type": "work"}}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:16.630376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c2471fa3-2480-40d1-91ae-17eb1d9c5a4c tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] Request method failure captured: Jul 12 14:39:16.630376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 14:39:16.630376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:39:16.630376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:39:16.630376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:39:16.630376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 120 Jul 12 14:39:16.630376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:39:16.630376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:39:16.630376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:39:16.630376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:16.630376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYeTFS_jCG-sM6gJ7_3imFPlI4yrbm6rUIU-fezi3k63DHQkeuM0He5Fy_L5_s-x0Rf7RYHxle9fKQfhmenxGATOR19fSpGY0yucU17R-cAecQAxHbewhxE1XmTJJ-OXH9pjdjVb6TKnDSt4B5LE5q4yqVtM0kaJ7Ql9krpIGUilK0c Jul 12 14:39:16.630376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:39:16.630376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:39:16.630376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:39:16.630376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:39:16.630376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:39:16.630376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:39:16.630376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: 91e67f47a1ee45689cd5a315ce580ecb Jul 12 14:39:16.630376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-VolumesNegativeTest-171858805 Jul 12 14:39:16.630376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:39:16.630376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:39:16.631970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/91e67f47a1ee45689cd5a315ce580ecb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/91e67f47a1ee45689cd5a315ce580ecb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/91e67f47a1ee45689cd5a315ce580ecb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_91e67f47a1ee45689cd5a315ce580ecb", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:39:16.631970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-VolumesNegativeTest-171858805 Jul 12 14:39:16.631970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: 91e67f47a1ee45689cd5a315ce580ecb Jul 12 14:39:16.631970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-VolumesNegativeTest-171858805 Jul 12 14:39:16.631970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-VolumesNegativeTest-171858805-project Jul 12 14:39:16.631970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:39:16.631970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:39:16.631970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: 326ecee0e4a445feb9f39335afc4c21c Jul 12 14:39:16.631970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-VolumesNegativeTest-171858805-project Jul 12 14:39:16.631970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Jul 12 14:39:16.631970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1473859756", "metadata": {"Type": "work"}}} Jul 12 14:39:16.631970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: Jul 12 14:39:16.631970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 14:39:16.634224 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1473859756', 'metadata': {'Type': 'work'}}}} Jul 12 14:39:16.634224 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:16.634224 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:16.634224 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 14:39:16.634224 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 14:39:16.634224 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 14:39:16.634224 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise error Jul 12 14:39:16.634224 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 12 14:39:16.634224 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:16.634224 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 12 14:39:16.634224 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 14:39:16.634224 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:16.634224 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 14:39:16.634224 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi '0' Jul 12 14:39:16.634224 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:16.634224 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:16.634224 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:16.634224 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:16.634224 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:16.634224 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:16.634224 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:16.634224 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:16.636146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 14:39:16.636146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 14:39:16.636146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:16.636146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:16.636146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 14:39:16.636146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 14:39:16.636146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 14:39:16.636146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 14:39:16.636146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 14:39:16.636146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 14:39:16.636146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 14:39:16.636146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:16.636146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:16.636146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:16.636146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:16.636146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:16.636146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:16.636146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 14:39:16.636146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 14:39:16.637577 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 14:39:16.637577 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:16.640756 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c2471fa3-2480-40d1-91ae-17eb1d9c5a4c tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:16.650245 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-c2471fa3-2480-40d1-91ae-17eb1d9c5a4c tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.022735 Jul 12 14:39:16.650245 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 2/2] 10.222.0.30 () {60 vars in 1155 bytes} [Tue Jul 12 14:39:16 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 12 14:39:16.660330 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-62a56d43-86ed-4bc3-a41c-49dd4a48ea58 tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] Action: 'create', calling method: .version_select at 0x7f962ea335e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1084721667", "metadata": {"Type": "work"}}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:16.670361 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-62a56d43-86ed-4bc3-a41c-49dd4a48ea58 tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] Request method failure captured: Jul 12 14:39:16.670361 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 14:39:16.670361 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:39:16.670361 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:39:16.670361 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:39:16.670361 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 119 Jul 12 14:39:16.670361 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:39:16.670361 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:39:16.670361 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:39:16.670361 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:16.670361 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYeTFS_jCG-sM6gJ7_3imFPlI4yrbm6rUIU-fezi3k63DHQkeuM0He5Fy_L5_s-x0Rf7RYHxle9fKQfhmenxGATOR19fSpGY0yucU17R-cAecQAxHbewhxE1XmTJJ-OXH9pjdjVb6TKnDSt4B5LE5q4yqVtM0kaJ7Ql9krpIGUilK0c Jul 12 14:39:16.670361 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:39:16.670361 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:39:16.670361 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:39:16.670361 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:39:16.670361 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:39:16.670361 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:39:16.670361 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: 91e67f47a1ee45689cd5a315ce580ecb Jul 12 14:39:16.670361 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-VolumesNegativeTest-171858805 Jul 12 14:39:16.670361 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:39:16.670361 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:39:16.673865 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/91e67f47a1ee45689cd5a315ce580ecb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/91e67f47a1ee45689cd5a315ce580ecb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/91e67f47a1ee45689cd5a315ce580ecb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_91e67f47a1ee45689cd5a315ce580ecb", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:39:16.673865 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-VolumesNegativeTest-171858805 Jul 12 14:39:16.673865 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: 91e67f47a1ee45689cd5a315ce580ecb Jul 12 14:39:16.673865 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-VolumesNegativeTest-171858805 Jul 12 14:39:16.673865 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-VolumesNegativeTest-171858805-project Jul 12 14:39:16.673865 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:39:16.673865 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:39:16.673865 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: 326ecee0e4a445feb9f39335afc4c21c Jul 12 14:39:16.673865 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-VolumesNegativeTest-171858805-project Jul 12 14:39:16.673865 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Jul 12 14:39:16.673865 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1084721667", "metadata": {"Type": "work"}}} Jul 12 14:39:16.673865 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: Jul 12 14:39:16.673865 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 14:39:16.674762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1084721667', 'metadata': {'Type': 'work'}}}} Jul 12 14:39:16.674762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:16.674762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:16.674762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 14:39:16.674762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 14:39:16.674762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 14:39:16.674762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise error Jul 12 14:39:16.674762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 12 14:39:16.674762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:16.674762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 12 14:39:16.674762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 14:39:16.674762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:16.674762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 14:39:16.674762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi '' Jul 12 14:39:16.674762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:16.674762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:16.674762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:16.674762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:16.674762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:16.674762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:16.674762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:16.674762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:16.676213 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 14:39:16.676213 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 14:39:16.676213 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:16.676213 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:16.676213 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 14:39:16.676213 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 14:39:16.676213 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 14:39:16.676213 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 14:39:16.676213 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 14:39:16.676213 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 14:39:16.676213 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 14:39:16.676213 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:16.676213 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:16.676213 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:16.676213 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:16.676213 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:16.676213 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:16.676213 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 14:39:16.676213 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 14:39:16.677336 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 14:39:16.677336 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:16.677336 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-62a56d43-86ed-4bc3-a41c-49dd4a48ea58 tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:16.677336 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-62a56d43-86ed-4bc3-a41c-49dd4a48ea58 tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018412 Jul 12 14:39:16.678616 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 3/3] 10.222.0.30 () {60 vars in 1155 bytes} [Tue Jul 12 14:39:16 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 14:39:16.694943 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-abbfd36c-c44e-45f6-b3b9-7552e79877c3 tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] Calling method '.version_select at 0x7f962e95a670>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:16.913023 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-f4790dd8-cc42-4e08-9847-138ac4dd59f8 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Action: 'create', calling method: .version_select at 0x7f962ea325e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-143230187"}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:17.280271 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.wsgi [None req-abbfd36c-c44e-45f6-b3b9-7552e79877c3 tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] HTTP exception thrown: Volume tempest-invalid-903420412 could not be found. Jul 12 14:39:17.285743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-abbfd36c-c44e-45f6-b3b9-7552e79877c3 tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] Request method failure captured: Jul 12 14:39:17.285743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-903420412 HTTP/1.1 Jul 12 14:39:17.285743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:39:17.285743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:39:17.285743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:39:17.285743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 0 Jul 12 14:39:17.285743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:39:17.285743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:39:17.285743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:39:17.285743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:17.285743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYeTFS_jCG-sM6gJ7_3imFPlI4yrbm6rUIU-fezi3k63DHQkeuM0He5Fy_L5_s-x0Rf7RYHxle9fKQfhmenxGATOR19fSpGY0yucU17R-cAecQAxHbewhxE1XmTJJ-OXH9pjdjVb6TKnDSt4B5LE5q4yqVtM0kaJ7Ql9krpIGUilK0c Jul 12 14:39:17.285743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:39:17.285743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:39:17.285743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:39:17.285743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:39:17.285743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:39:17.285743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:39:17.285743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: 91e67f47a1ee45689cd5a315ce580ecb Jul 12 14:39:17.285743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-VolumesNegativeTest-171858805 Jul 12 14:39:17.285743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:39:17.285743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:39:17.287397 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/91e67f47a1ee45689cd5a315ce580ecb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/91e67f47a1ee45689cd5a315ce580ecb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/91e67f47a1ee45689cd5a315ce580ecb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_91e67f47a1ee45689cd5a315ce580ecb", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:39:17.287397 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-VolumesNegativeTest-171858805 Jul 12 14:39:17.287397 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: 91e67f47a1ee45689cd5a315ce580ecb Jul 12 14:39:17.287397 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-VolumesNegativeTest-171858805 Jul 12 14:39:17.287397 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-VolumesNegativeTest-171858805-project Jul 12 14:39:17.287397 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:39:17.287397 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:39:17.287397 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: 326ecee0e4a445feb9f39335afc4c21c Jul 12 14:39:17.287397 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-VolumesNegativeTest-171858805-project Jul 12 14:39:17.287397 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: Jul 12 14:39:17.287397 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Volume tempest-invalid-903420412 could not be found. Jul 12 14:39:17.287397 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'id': 'tempest-invalid-903420412'} Jul 12 14:39:17.287397 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:17.288329 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:17.288329 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 14:39:17.288329 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 14:39:17.288329 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 14:39:17.288329 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 14:39:17.288329 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 14:39:17.288329 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 14:39:17.288329 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 14:39:17.288329 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 14:39:17.288329 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 14:39:17.288329 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 14:39:17.288329 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:39:17.288329 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:39:17.288329 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:39:17.288329 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:39:17.288329 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-903420412 could not be found. (HTTP 404) (Request-ID: req-2894846a-2ee4-4aa5-a2cf-50ffb43ba0ad) Jul 12 14:39:17.288329 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:17.288329 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:17.288329 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:17.291287 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:17.291287 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 14:39:17.291287 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 14:39:17.291287 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 14:39:17.291287 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 14:39:17.291287 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 14:39:17.291287 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 14:39:17.291287 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 14:39:17.291287 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 14:39:17.291287 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 14:39:17.291287 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 14:39:17.291287 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 14:39:17.291287 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 14:39:17.291287 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 14:39:17.291287 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 14:39:17.291287 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 14:39:17.291287 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 14:39:17.291287 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 14:39:17.291287 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 14:39:17.293910 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:39:17.293910 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:39:17.293910 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:39:17.293910 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:39:17.293910 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-903420412 could not be found. Jul 12 14:39:17.293910 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:17.293910 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:17.293910 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:17.293910 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:17.293910 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:17.293910 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:17.293910 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:17.293910 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:17.293910 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 14:39:17.293910 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 14:39:17.293910 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:17.293910 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:17.293910 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 14:39:17.293910 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:39:17.293910 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-903420412 could not be found. Jul 12 14:39:17.298520 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:17.298520 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:17.298520 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:17.298520 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:17.298520 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:17.298520 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:17.298520 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:39:17.298520 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:39:17.298520 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-903420412 could not be found. Jul 12 14:39:17.298520 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:17.298520 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-abbfd36c-c44e-45f6-b3b9-7552e79877c3 tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] Returning 404 to user: Volume tempest-invalid-903420412 could not be found. {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:17.298520 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-abbfd36c-c44e-45f6-b3b9-7552e79877c3 tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-903420412" status: 404 len: 98 microversion: 2.1 time: 0.603623 Jul 12 14:39:17.298520 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 4/4] 10.222.0.30 () {58 vars in 1214 bytes} [Tue Jul 12 14:39:16 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-903420412 => generated 98 bytes in 606 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 14:39:17.307301 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-69254366-70c0-4eab-85c9-deab14163fb5 tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004322 Jul 12 14:39:17.323782 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 5/5] 10.222.0.30 () {58 vars in 1139 bytes} [Tue Jul 12 14:39:17 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 12 14:39:17.336554 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-4a1cd3e9-bc5c-4c3e-956f-7091f9314164 tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005259 Jul 12 14:39:17.341650 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 6/6] 10.222.0.30 () {58 vars in 1136 bytes} [Tue Jul 12 14:39:17 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 12 14:39:17.347467 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-5ef8ac13-7e97-4131-863f-2453f2f4bf98 tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] Calling method '.version_select at 0x7f962e888a60>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:18.302531 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.wsgi [None req-5ef8ac13-7e97-4131-863f-2453f2f4bf98 tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] HTTP exception thrown: Volume 5d64d94e-1ef1-4c55-9df6-0ac018068c2b could not be found. Jul 12 14:39:18.302531 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-5ef8ac13-7e97-4131-863f-2453f2f4bf98 tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] Request method failure captured: Jul 12 14:39:18.302531 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: DELETE /compute/v2.1/os-volumes/5d64d94e-1ef1-4c55-9df6-0ac018068c2b HTTP/1.1 Jul 12 14:39:18.302531 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:39:18.302531 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:39:18.302531 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:39:18.302531 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 0 Jul 12 14:39:18.302531 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:39:18.302531 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:39:18.302531 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:39:18.302531 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:18.302531 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYeTFS_jCG-sM6gJ7_3imFPlI4yrbm6rUIU-fezi3k63DHQkeuM0He5Fy_L5_s-x0Rf7RYHxle9fKQfhmenxGATOR19fSpGY0yucU17R-cAecQAxHbewhxE1XmTJJ-OXH9pjdjVb6TKnDSt4B5LE5q4yqVtM0kaJ7Ql9krpIGUilK0c Jul 12 14:39:18.302531 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:39:18.302531 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:39:18.302531 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:39:18.302531 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:39:18.302531 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:39:18.302531 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:39:18.302531 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: 91e67f47a1ee45689cd5a315ce580ecb Jul 12 14:39:18.302531 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-VolumesNegativeTest-171858805 Jul 12 14:39:18.302531 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:39:18.302531 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:39:18.311744 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/91e67f47a1ee45689cd5a315ce580ecb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/91e67f47a1ee45689cd5a315ce580ecb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/91e67f47a1ee45689cd5a315ce580ecb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_91e67f47a1ee45689cd5a315ce580ecb", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:39:18.311744 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-VolumesNegativeTest-171858805 Jul 12 14:39:18.311744 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: 91e67f47a1ee45689cd5a315ce580ecb Jul 12 14:39:18.311744 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-VolumesNegativeTest-171858805 Jul 12 14:39:18.311744 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-VolumesNegativeTest-171858805-project Jul 12 14:39:18.311744 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:39:18.311744 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:39:18.311744 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: 326ecee0e4a445feb9f39335afc4c21c Jul 12 14:39:18.311744 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-VolumesNegativeTest-171858805-project Jul 12 14:39:18.311744 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: Jul 12 14:39:18.311744 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Volume 5d64d94e-1ef1-4c55-9df6-0ac018068c2b could not be found. Jul 12 14:39:18.311744 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'id': '5d64d94e-1ef1-4c55-9df6-0ac018068c2b'} Jul 12 14:39:18.311744 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:18.313619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:18.313619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 14:39:18.313619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 14:39:18.313619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 14:39:18.313619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 14:39:18.313619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 14:39:18.313619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 14:39:18.313619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 14:39:18.313619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 14:39:18.313619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 14:39:18.313619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 14:39:18.313619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:39:18.313619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:39:18.313619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:39:18.313619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:39:18.313619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5d64d94e-1ef1-4c55-9df6-0ac018068c2b could not be found. (HTTP 404) (Request-ID: req-d6556d12-8115-41bf-8c77-d2ed3f8f6e88) Jul 12 14:39:18.313619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:18.313619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:18.313619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:18.316055 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:18.316055 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 14:39:18.316055 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 14:39:18.316055 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 14:39:18.316055 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 14:39:18.316055 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 14:39:18.316055 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 14:39:18.316055 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 14:39:18.316055 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 14:39:18.316055 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 14:39:18.316055 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 14:39:18.316055 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 14:39:18.316055 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 14:39:18.316055 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 14:39:18.316055 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 14:39:18.316055 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 14:39:18.316055 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 14:39:18.316055 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 14:39:18.316055 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 14:39:18.321349 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:39:18.321349 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:39:18.321349 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:39:18.321349 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:39:18.321349 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5d64d94e-1ef1-4c55-9df6-0ac018068c2b could not be found. Jul 12 14:39:18.321349 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:18.321349 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:18.321349 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:18.321349 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:18.321349 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:18.321349 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:18.321349 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:18.321349 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:18.321349 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 14:39:18.321349 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 14:39:18.321349 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:18.321349 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:18.321349 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 14:39:18.321349 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:39:18.323856 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5d64d94e-1ef1-4c55-9df6-0ac018068c2b could not be found. Jul 12 14:39:18.323856 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:18.323856 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:18.323856 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:18.323856 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:18.323856 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:18.323856 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:18.323856 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:39:18.323856 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:39:18.323856 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5d64d94e-1ef1-4c55-9df6-0ac018068c2b could not be found. Jul 12 14:39:18.323856 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:18.323856 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-5ef8ac13-7e97-4131-863f-2453f2f4bf98 tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] Returning 404 to user: Volume 5d64d94e-1ef1-4c55-9df6-0ac018068c2b could not be found. {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:18.323856 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-5ef8ac13-7e97-4131-863f-2453f2f4bf98 tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/5d64d94e-1ef1-4c55-9df6-0ac018068c2b" status: 404 len: 109 microversion: 2.1 time: 0.724324 Jul 12 14:39:18.323856 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 7/7] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Jul 12 14:39:17 2022] DELETE /compute/v2.1/os-volumes/5d64d94e-1ef1-4c55-9df6-0ac018068c2b => generated 109 bytes in 726 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:39:18.325413 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-992250e1-f175-43fa-85c4-ef1b516538d5 tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] Calling method '.version_select at 0x7f962e888ee0>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:18.334470 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.wsgi [None req-992250e1-f175-43fa-85c4-ef1b516538d5 tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] HTTP exception thrown: Volume 9df9dd03-0a2d-4c96-acde-ea66be9de363 could not be found. Jul 12 14:39:18.337557 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-992250e1-f175-43fa-85c4-ef1b516538d5 tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] Request method failure captured: Jul 12 14:39:18.337557 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: GET /compute/v2.1/os-volumes/9df9dd03-0a2d-4c96-acde-ea66be9de363 HTTP/1.1 Jul 12 14:39:18.337557 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:39:18.337557 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:39:18.337557 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:39:18.337557 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 0 Jul 12 14:39:18.337557 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:39:18.337557 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:39:18.337557 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:39:18.337557 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:18.337557 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYeTFS_jCG-sM6gJ7_3imFPlI4yrbm6rUIU-fezi3k63DHQkeuM0He5Fy_L5_s-x0Rf7RYHxle9fKQfhmenxGATOR19fSpGY0yucU17R-cAecQAxHbewhxE1XmTJJ-OXH9pjdjVb6TKnDSt4B5LE5q4yqVtM0kaJ7Ql9krpIGUilK0c Jul 12 14:39:18.337557 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:39:18.337557 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:39:18.337557 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:39:18.337557 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:39:18.337557 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:39:18.337557 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:39:18.337557 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: 91e67f47a1ee45689cd5a315ce580ecb Jul 12 14:39:18.337557 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-VolumesNegativeTest-171858805 Jul 12 14:39:18.337557 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:39:18.337557 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:39:18.338830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/91e67f47a1ee45689cd5a315ce580ecb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/91e67f47a1ee45689cd5a315ce580ecb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/91e67f47a1ee45689cd5a315ce580ecb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_91e67f47a1ee45689cd5a315ce580ecb", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:39:18.338830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-VolumesNegativeTest-171858805 Jul 12 14:39:18.338830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: 91e67f47a1ee45689cd5a315ce580ecb Jul 12 14:39:18.338830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-VolumesNegativeTest-171858805 Jul 12 14:39:18.338830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-VolumesNegativeTest-171858805-project Jul 12 14:39:18.338830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:39:18.338830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:39:18.338830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: 326ecee0e4a445feb9f39335afc4c21c Jul 12 14:39:18.338830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-VolumesNegativeTest-171858805-project Jul 12 14:39:18.338830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: Jul 12 14:39:18.338830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Volume 9df9dd03-0a2d-4c96-acde-ea66be9de363 could not be found. Jul 12 14:39:18.338830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'id': '9df9dd03-0a2d-4c96-acde-ea66be9de363'} Jul 12 14:39:18.338830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:18.339529 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:18.339529 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 14:39:18.339529 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 14:39:18.339529 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 14:39:18.339529 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 14:39:18.339529 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 14:39:18.339529 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 14:39:18.339529 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 14:39:18.339529 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 14:39:18.339529 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 14:39:18.339529 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 14:39:18.339529 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:39:18.339529 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:39:18.339529 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:39:18.339529 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:39:18.339529 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9df9dd03-0a2d-4c96-acde-ea66be9de363 could not be found. (HTTP 404) (Request-ID: req-f27040da-06ab-4811-b1e3-61b986e42083) Jul 12 14:39:18.339529 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:18.339529 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:18.339529 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:18.340467 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:18.340467 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 14:39:18.340467 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 14:39:18.340467 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 14:39:18.340467 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 14:39:18.340467 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 14:39:18.340467 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 14:39:18.340467 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 14:39:18.340467 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 14:39:18.340467 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 14:39:18.340467 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 14:39:18.340467 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 14:39:18.340467 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 14:39:18.340467 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 14:39:18.340467 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 14:39:18.340467 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 14:39:18.340467 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 14:39:18.340467 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 14:39:18.340467 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 14:39:18.344419 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:39:18.344419 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:39:18.344419 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:39:18.344419 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:39:18.344419 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9df9dd03-0a2d-4c96-acde-ea66be9de363 could not be found. Jul 12 14:39:18.344419 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:18.344419 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:18.344419 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:18.344419 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:18.344419 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:18.344419 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:18.344419 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:18.344419 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:18.344419 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 14:39:18.344419 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 14:39:18.344419 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:18.344419 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:18.344419 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 14:39:18.344419 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:39:18.351354 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9df9dd03-0a2d-4c96-acde-ea66be9de363 could not be found. Jul 12 14:39:18.351354 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:18.351354 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:18.351354 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:18.351354 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:18.351354 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:18.351354 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:18.351354 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:39:18.351354 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:39:18.351354 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9df9dd03-0a2d-4c96-acde-ea66be9de363 could not be found. Jul 12 14:39:18.351354 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:39:18.351354 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-992250e1-f175-43fa-85c4-ef1b516538d5 tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] Returning 404 to user: Volume 9df9dd03-0a2d-4c96-acde-ea66be9de363 could not be found. {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:18.351354 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-992250e1-f175-43fa-85c4-ef1b516538d5 tempest-VolumesNegativeTest-171858805 tempest-VolumesNegativeTest-171858805-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/9df9dd03-0a2d-4c96-acde-ea66be9de363" status: 404 len: 109 microversion: 2.1 time: 0.275999 Jul 12 14:39:18.354344 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 8/8] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Jul 12 14:39:18 2022] GET /compute/v2.1/os-volumes/9df9dd03-0a2d-4c96-acde-ea66be9de363 => generated 109 bytes in 282 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:39:18.925224 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-f4790dd8-cc42-4e08-9847-138ac4dd59f8 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.396306 Jul 12 14:39:18.926173 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 1/9] 10.222.0.30 () {60 vars in 1154 bytes} [Tue Jul 12 14:39:15 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3399 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 12 14:39:18.939878 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-bac88e46-7257-45bb-9830-f32caa273d3b tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Calling method '.version_select at 0x7f962e888af0>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:19.030845 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-bac88e46-7257-45bb-9830-f32caa273d3b tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/7b7f84fc-591d-4486-9bc4-74f60752364f" status: 200 len: 344 microversion: 2.1 time: 0.096686 Jul 12 14:39:19.031583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 9/10] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Jul 12 14:39:18 2022] GET /compute/v2.1/os-volumes/7b7f84fc-591d-4486-9bc4-74f60752364f => generated 344 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:39:20.044195 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-f938eb46-92a7-4bfb-8e10-71b849f48a81 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Calling method '.version_select at 0x7f962e8f64c0>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:20.203050 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-f938eb46-92a7-4bfb-8e10-71b849f48a81 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/7b7f84fc-591d-4486-9bc4-74f60752364f" status: 200 len: 344 microversion: 2.1 time: 0.162548 Jul 12 14:39:20.203898 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 2/11] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Jul 12 14:39:20 2022] GET /compute/v2.1/os-volumes/7b7f84fc-591d-4486-9bc4-74f60752364f => generated 344 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:21.219338 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-ece6ffa7-14d1-4577-9697-37315899e261 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Calling method '.version_select at 0x7f962e888700>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:21.327586 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-ece6ffa7-14d1-4577-9697-37315899e261 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/7b7f84fc-591d-4486-9bc4-74f60752364f" status: 200 len: 345 microversion: 2.1 time: 0.115449 Jul 12 14:39:21.328226 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 10/12] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Jul 12 14:39:21 2022] GET /compute/v2.1/os-volumes/7b7f84fc-591d-4486-9bc4-74f60752364f => generated 345 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:21.341794 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-f77fed81-f61f-4a52-adee-d9f495e4b4d5 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Action: 'create', calling method: .version_select at 0x7f962e8f6a60>, body: {"snapshot": {"volume_id": "7b7f84fc-591d-4486-9bc4-74f60752364f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-933636230"}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:22.283459 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-f77fed81-f61f-4a52-adee-d9f495e4b4d5 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.947285 Jul 12 14:39:22.284496 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 3/13] 10.222.0.30 () {60 vars in 1161 bytes} [Tue Jul 12 14:39:21 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:22.294113 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-4fc0ad53-ecbb-4cc4-b093-93189208d828 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Calling method '.version_select at 0x7f962e95a670>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:22.347938 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-4fc0ad53-ecbb-4cc4-b093-93189208d828 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/cdceb8d7-3eb1-4948-acad-71e6454c5f9e" status: 200 len: 286 microversion: 2.1 time: 0.057409 Jul 12 14:39:22.351425 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 11/14] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Jul 12 14:39:22 2022] GET /compute/v2.1/os-snapshots/cdceb8d7-3eb1-4948-acad-71e6454c5f9e => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:39:22.358610 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-467bc439-28e8-43a1-a06b-19f26bc47b6b tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Calling method '.version_select at 0x7f962e90c160>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:22.693197 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-467bc439-28e8-43a1-a06b-19f26bc47b6b tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.338288 Jul 12 14:39:22.693916 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 4/15] 10.222.0.30 () {58 vars in 1139 bytes} [Tue Jul 12 14:39:22 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:22.705679 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-f91677dc-0a19-4c12-bb39-09e81122677c tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Calling method '.version_select at 0x7f962e899430>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:22.831510 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-f91677dc-0a19-4c12-bb39-09e81122677c tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/cdceb8d7-3eb1-4948-acad-71e6454c5f9e" status: 200 len: 286 microversion: 2.1 time: 0.131191 Jul 12 14:39:22.832070 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 12/16] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Jul 12 14:39:22 2022] GET /compute/v2.1/os-snapshots/cdceb8d7-3eb1-4948-acad-71e6454c5f9e => generated 286 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:23.854413 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-a8e91e77-f160-40ad-95a1-ac9012a80e81 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Calling method '.version_select at 0x7f962e90ce50>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:23.930146 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-a8e91e77-f160-40ad-95a1-ac9012a80e81 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/cdceb8d7-3eb1-4948-acad-71e6454c5f9e" status: 200 len: 286 microversion: 2.1 time: 0.090762 Jul 12 14:39:23.931006 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 5/17] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Jul 12 14:39:23 2022] GET /compute/v2.1/os-snapshots/cdceb8d7-3eb1-4948-acad-71e6454c5f9e => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:24.945112 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-005f7e02-9485-498a-b6d9-c4bd61e6a24b tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Calling method '.version_select at 0x7f962e95a0d0>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:25.019402 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-005f7e02-9485-498a-b6d9-c4bd61e6a24b tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/cdceb8d7-3eb1-4948-acad-71e6454c5f9e" status: 200 len: 286 microversion: 2.1 time: 0.078380 Jul 12 14:39:25.027188 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 13/18] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Jul 12 14:39:24 2022] GET /compute/v2.1/os-snapshots/cdceb8d7-3eb1-4948-acad-71e6454c5f9e => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:26.031890 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-02cfcf3e-0ee2-4884-9811-52003784556b tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Calling method '.version_select at 0x7f962e90cca0>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:26.102028 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-02cfcf3e-0ee2-4884-9811-52003784556b tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/cdceb8d7-3eb1-4948-acad-71e6454c5f9e" status: 200 len: 286 microversion: 2.1 time: 0.074903 Jul 12 14:39:26.103109 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 6/19] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Jul 12 14:39:26 2022] GET /compute/v2.1/os-snapshots/cdceb8d7-3eb1-4948-acad-71e6454c5f9e => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:27.114434 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-63c24a6f-b979-466e-9fde-2995637149b0 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Calling method '.version_select at 0x7f962e8884c0>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:27.199344 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-63c24a6f-b979-466e-9fde-2995637149b0 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/cdceb8d7-3eb1-4948-acad-71e6454c5f9e" status: 200 len: 287 microversion: 2.1 time: 0.089484 Jul 12 14:39:27.199916 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 14/20] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Jul 12 14:39:27 2022] GET /compute/v2.1/os-snapshots/cdceb8d7-3eb1-4948-acad-71e6454c5f9e => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:27.211716 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-7a7e55b5-f5bb-4975-a176-affb477f7858 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Calling method '.version_select at 0x7f962e90c550>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:27.360224 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-7a7e55b5-f5bb-4975-a176-affb477f7858 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/cdceb8d7-3eb1-4948-acad-71e6454c5f9e" status: 202 len: 0 microversion: 2.1 time: 0.152882 Jul 12 14:39:27.362027 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 7/21] 10.222.0.30 () {58 vars in 1253 bytes} [Tue Jul 12 14:39:27 2022] DELETE /compute/v2.1/os-snapshots/cdceb8d7-3eb1-4948-acad-71e6454c5f9e => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:39:27.376304 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-3d186a08-a82e-4cca-9a4c-82beba18b282 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Calling method '.version_select at 0x7f962e888dc0>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:27.445229 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-3d186a08-a82e-4cca-9a4c-82beba18b282 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/cdceb8d7-3eb1-4948-acad-71e6454c5f9e" status: 200 len: 286 microversion: 2.1 time: 0.077985 Jul 12 14:39:27.445843 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 15/22] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Jul 12 14:39:27 2022] GET /compute/v2.1/os-snapshots/cdceb8d7-3eb1-4948-acad-71e6454c5f9e => generated 286 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:28.135381 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-d42d0112-d5e8-43a0-a58d-9a567a9e1cb9 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Action: 'create', calling method: .version_select at 0x7f962e9f6280>, body: {"keypair": {"name": "tempest-keypair-645138716", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOUX4abTKZQcy7cFgqo1k+3Zt0/IKfFDAvrigx5r9dbpywmekyFU9kXkxTmg0UlcxICcEnl6wZMddsh72QO9iuM3Y2QwdoRVH2GlADLF8uhJejIlDxt4bHUedhln2ZpKQ=="}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:28.219984 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-d42d0112-d5e8-43a0-a58d-9a567a9e1cb9 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Getting quotas for project 52569bf4eba24c2a9fa0ef8c26b8b22d. Resources: {'key_pairs'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:39:28.229250 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-d42d0112-d5e8-43a0-a58d-9a567a9e1cb9 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Getting quotas for user 8f118c0ba8494e6e9f5a4488ebf8d220 and project 52569bf4eba24c2a9fa0ef8c26b8b22d. Resources: {'key_pairs'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:39:28.422831 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-d42d0112-d5e8-43a0-a58d-9a567a9e1cb9 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.878317 Jul 12 14:39:28.424410 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 8/23] 10.222.0.30 () {60 vars in 1158 bytes} [Tue Jul 12 14:39:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:28.459909 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-7d03590e-c634-4cb1-89c1-677d962b05d2 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Calling method '.version_select at 0x7f962e888b80>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:28.526730 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-7d03590e-c634-4cb1-89c1-677d962b05d2 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/cdceb8d7-3eb1-4948-acad-71e6454c5f9e" status: 200 len: 286 microversion: 2.1 time: 0.073215 Jul 12 14:39:28.531847 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 16/24] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Jul 12 14:39:28 2022] GET /compute/v2.1/os-snapshots/cdceb8d7-3eb1-4948-acad-71e6454c5f9e => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:29.538909 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-aaf1d829-11b3-428f-8244-0fed6c4f9562 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Calling method '.version_select at 0x7f962e868940>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:29.599123 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-aaf1d829-11b3-428f-8244-0fed6c4f9562 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/cdceb8d7-3eb1-4948-acad-71e6454c5f9e" status: 200 len: 286 microversion: 2.1 time: 0.063860 Jul 12 14:39:29.599878 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 9/25] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Jul 12 14:39:29 2022] GET /compute/v2.1/os-snapshots/cdceb8d7-3eb1-4948-acad-71e6454c5f9e => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:30.262280 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-6ed652f8-2079-485f-bf5e-81dd5c232ef8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1121073367", "imageRef": "a66ccacb-7b1e-4f51-9eaf-069a356e0fdb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:30.430785 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.network.neutron [None req-6ed652f8-2079-485f-bf5e-81dd5c232ef8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] validate_networks() for [('819820a3-8857-4e62-88e8-410b4a79b856', None, None, None, None, None)] {{(pid=129981) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:39:30.613219 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-7c0800ac-3851-4a97-b1d3-5c8fe7f3a018 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Calling method '.version_select at 0x7f962e898040>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:30.664052 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.wsgi [None req-7c0800ac-3851-4a97-b1d3-5c8fe7f3a018 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] HTTP exception thrown: Snapshot cdceb8d7-3eb1-4948-acad-71e6454c5f9e could not be found. Jul 12 14:39:30.671672 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-7c0800ac-3851-4a97-b1d3-5c8fe7f3a018 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Request method failure captured: Jul 12 14:39:30.671672 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: request: GET /compute/v2.1/os-snapshots/cdceb8d7-3eb1-4948-acad-71e6454c5f9e HTTP/1.1 Jul 12 14:39:30.671672 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept: application/json Jul 12 14:39:30.671672 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept-Encoding: identity Jul 12 14:39:30.671672 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Connection: close Jul 12 14:39:30.671672 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Length: 0 Jul 12 14:39:30.671672 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Type: application/json Jul 12 14:39:30.671672 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Host: 10.222.0.30 Jul 12 14:39:30.671672 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Openstack-System-Scope: None Jul 12 14:39:30.671672 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:30.671672 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Auth-Token: gAAAAABizYeTrfeSn2kQmY9CC0BibqJo_4F5iYjtUuSEr7strJ81U-mtN7kH5Jy39mSB6B2h4Vzy7Qugq5QIBoPrW1_Dwz1rNwjKdovCG529h7SQffwaqpcYm8fv5WtGSdFwOyS-INoT7vC1CIc22Ny44NFu0AjHU_eOcQmOg8XieU79kfx2wIY Jul 12 14:39:30.671672 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Id: None Jul 12 14:39:30.671672 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Name: None Jul 12 14:39:30.671672 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Identity-Status: Confirmed Jul 12 14:39:30.671672 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Is-Admin-Project: True Jul 12 14:39:30.671672 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Id: default Jul 12 14:39:30.671672 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Name: Default Jul 12 14:39:30.671672 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Id: 98f3b8e5987e4daebdcfdd6311032a67 Jul 12 14:39:30.671672 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1587033204 Jul 12 14:39:30.671672 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Role: member,reader Jul 12 14:39:30.671672 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Roles: member,reader Jul 12 14:39:30.673065 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/98f3b8e5987e4daebdcfdd6311032a67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/98f3b8e5987e4daebdcfdd6311032a67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/98f3b8e5987e4daebdcfdd6311032a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_98f3b8e5987e4daebdcfdd6311032a67", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:39:30.673065 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1587033204 Jul 12 14:39:30.673065 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Id: 98f3b8e5987e4daebdcfdd6311032a67 Jul 12 14:39:30.673065 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1587033204 Jul 12 14:39:30.673065 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User: tempest-VolumesSnapshotsTestJSON-1587033204-project Jul 12 14:39:30.673065 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Id: default Jul 12 14:39:30.673065 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Name: Default Jul 12 14:39:30.673065 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Id: d2bb01bd22b14c418d6465441b0646d8 Jul 12 14:39:30.673065 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1587033204-project Jul 12 14:39:30.673065 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: method: Jul 12 14:39:30.673065 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: exception: Snapshot cdceb8d7-3eb1-4948-acad-71e6454c5f9e could not be found. Jul 12 14:39:30.673065 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: action_args: {'id': 'cdceb8d7-3eb1-4948-acad-71e6454c5f9e'} Jul 12 14:39:30.673065 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:30.674110 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:30.674110 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 12 14:39:30.674110 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 12 14:39:30.674110 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 12 14:39:30.674110 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 12 14:39:30.674110 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 12 14:39:30.674110 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 12 14:39:30.674110 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 14:39:30.674110 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 14:39:30.674110 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 14:39:30.674110 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 14:39:30.674110 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:39:30.674110 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:39:30.674110 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:39:30.674110 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:39:30.674110 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot cdceb8d7-3eb1-4948-acad-71e6454c5f9e could not be found. (HTTP 404) (Request-ID: req-ee0cfa30-a669-4e7a-9f0f-0035d716f661) Jul 12 14:39:30.674110 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:39:30.674110 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:30.675235 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:39:30.675235 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:30.675235 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 12 14:39:30.675235 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 12 14:39:30.675235 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 14:39:30.675235 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 14:39:30.675235 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 12 14:39:30.675235 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 12 14:39:30.675235 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 14:39:30.675235 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 14:39:30.675235 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 12 14:39:30.675235 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 12 14:39:30.675235 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 12 14:39:30.675235 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 12 14:39:30.675235 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 12 14:39:30.675235 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 12 14:39:30.675235 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 14:39:30.675235 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 14:39:30.675235 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 14:39:30.676246 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 14:39:30.676246 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:39:30.676246 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:39:30.676246 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:39:30.676246 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:39:30.676246 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot cdceb8d7-3eb1-4948-acad-71e6454c5f9e could not be found. Jul 12 14:39:30.676246 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:39:30.676246 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:30.676246 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:39:30.676246 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:30.676246 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:30.676246 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:30.676246 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:30.676246 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:30.676246 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 14:39:30.676246 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 14:39:30.676246 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:30.676246 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:30.676246 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 12 14:39:30.676246 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:39:30.677283 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot cdceb8d7-3eb1-4948-acad-71e6454c5f9e could not be found. Jul 12 14:39:30.677283 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:39:30.677283 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:30.677283 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:39:30.677283 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:30.677283 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:30.677283 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:30.677283 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:39:30.677283 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:39:30.677283 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot cdceb8d7-3eb1-4948-acad-71e6454c5f9e could not be found. Jul 12 14:39:30.677283 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:39:30.680117 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-7c0800ac-3851-4a97-b1d3-5c8fe7f3a018 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Returning 404 to user: Snapshot cdceb8d7-3eb1-4948-acad-71e6454c5f9e could not be found. {{(pid=129980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:30.683535 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-7c0800ac-3851-4a97-b1d3-5c8fe7f3a018 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/cdceb8d7-3eb1-4948-acad-71e6454c5f9e" status: 404 len: 111 microversion: 2.1 time: 0.076265 Jul 12 14:39:30.686369 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 10/26] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Jul 12 14:39:30 2022] GET /compute/v2.1/os-snapshots/cdceb8d7-3eb1-4948-acad-71e6454c5f9e => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:39:30.694752 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-e164a4bc-425c-4b95-beae-c51b449669cb tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Calling method '.version_select at 0x7f962e898e50>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:31.047869 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-e164a4bc-425c-4b95-beae-c51b449669cb tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/7b7f84fc-591d-4486-9bc4-74f60752364f" status: 202 len: 0 microversion: 2.1 time: 0.357331 Jul 12 14:39:31.048657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 11/27] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Jul 12 14:39:30 2022] DELETE /compute/v2.1/os-volumes/7b7f84fc-591d-4486-9bc4-74f60752364f => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:39:31.056623 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-1892b892-22c5-4a94-8ff6-18f56c427584 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Calling method '.version_select at 0x7f962dfff5e0>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:31.221414 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-1892b892-22c5-4a94-8ff6-18f56c427584 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/7b7f84fc-591d-4486-9bc4-74f60752364f" status: 200 len: 344 microversion: 2.1 time: 0.168431 Jul 12 14:39:31.222656 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 12/28] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Jul 12 14:39:31 2022] GET /compute/v2.1/os-volumes/7b7f84fc-591d-4486-9bc4-74f60752364f => generated 344 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:39:32.355487 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ba63fe86-e3fc-40d5-825d-0e49ae882302 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Action: 'create', calling method: .version_select at 0x7f962e898d30>, body: {"keypair": {"name": "tempest-keypair-1576898000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObHfaLaVr7zM5JKTEw0re0aTO3Ni9HIQ+0jurZsD9g90SJSZm+9ry2Xra2YKznbPlb0oIO/AmuIBWQWirfXrG+HIoF91r5aPda17MUQZBaXg2TUvzq+rCm+5PoChxQldw=="}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:32.400979 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-ba63fe86-e3fc-40d5-825d-0e49ae882302 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Getting quotas for project 3f550f8d11a74b8da5ad84607b79ac37. Resources: {'key_pairs'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:39:32.420023 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-ba63fe86-e3fc-40d5-825d-0e49ae882302 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Getting quotas for user a760d437b597441fa9a4595995c5bc6f and project 3f550f8d11a74b8da5ad84607b79ac37. Resources: {'key_pairs'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:39:32.594573 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ba63fe86-e3fc-40d5-825d-0e49ae882302 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.626882 Jul 12 14:39:32.595170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 13/29] 10.222.0.30 () {62 vars in 1199 bytes} [Tue Jul 12 14:39:31 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 628 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 12 14:39:32.608397 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-f677a8a2-34ac-4653-847c-c9b9e82bd0e7 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Calling method '.version_select at 0x7f962dffc670>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:32.799187 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.wsgi [None req-f677a8a2-34ac-4653-847c-c9b9e82bd0e7 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] HTTP exception thrown: Volume 7b7f84fc-591d-4486-9bc4-74f60752364f could not be found. Jul 12 14:39:32.801833 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-f677a8a2-34ac-4653-847c-c9b9e82bd0e7 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Request method failure captured: Jul 12 14:39:32.801833 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: request: GET /compute/v2.1/os-volumes/7b7f84fc-591d-4486-9bc4-74f60752364f HTTP/1.1 Jul 12 14:39:32.801833 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept: application/json Jul 12 14:39:32.801833 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept-Encoding: identity Jul 12 14:39:32.801833 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Connection: close Jul 12 14:39:32.801833 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Length: 0 Jul 12 14:39:32.801833 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Type: application/json Jul 12 14:39:32.801833 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Host: 10.222.0.30 Jul 12 14:39:32.801833 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Openstack-System-Scope: None Jul 12 14:39:32.801833 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:32.801833 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Auth-Token: gAAAAABizYeTrfeSn2kQmY9CC0BibqJo_4F5iYjtUuSEr7strJ81U-mtN7kH5Jy39mSB6B2h4Vzy7Qugq5QIBoPrW1_Dwz1rNwjKdovCG529h7SQffwaqpcYm8fv5WtGSdFwOyS-INoT7vC1CIc22Ny44NFu0AjHU_eOcQmOg8XieU79kfx2wIY Jul 12 14:39:32.801833 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Id: None Jul 12 14:39:32.801833 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Name: None Jul 12 14:39:32.801833 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Identity-Status: Confirmed Jul 12 14:39:32.801833 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Is-Admin-Project: True Jul 12 14:39:32.801833 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Id: default Jul 12 14:39:32.801833 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Name: Default Jul 12 14:39:32.801833 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Id: 98f3b8e5987e4daebdcfdd6311032a67 Jul 12 14:39:32.801833 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1587033204 Jul 12 14:39:32.801833 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Role: member,reader Jul 12 14:39:32.801833 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Roles: member,reader Jul 12 14:39:32.802941 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/98f3b8e5987e4daebdcfdd6311032a67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/98f3b8e5987e4daebdcfdd6311032a67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/98f3b8e5987e4daebdcfdd6311032a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_98f3b8e5987e4daebdcfdd6311032a67", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:39:32.802941 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1587033204 Jul 12 14:39:32.802941 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Id: 98f3b8e5987e4daebdcfdd6311032a67 Jul 12 14:39:32.802941 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1587033204 Jul 12 14:39:32.802941 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User: tempest-VolumesSnapshotsTestJSON-1587033204-project Jul 12 14:39:32.802941 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Id: default Jul 12 14:39:32.802941 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Name: Default Jul 12 14:39:32.802941 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Id: d2bb01bd22b14c418d6465441b0646d8 Jul 12 14:39:32.802941 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1587033204-project Jul 12 14:39:32.802941 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: method: Jul 12 14:39:32.802941 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: exception: Volume 7b7f84fc-591d-4486-9bc4-74f60752364f could not be found. Jul 12 14:39:32.802941 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: action_args: {'id': '7b7f84fc-591d-4486-9bc4-74f60752364f'} Jul 12 14:39:32.802941 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:32.803686 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:32.803686 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 14:39:32.803686 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 14:39:32.803686 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 14:39:32.803686 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 14:39:32.803686 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 14:39:32.803686 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 14:39:32.803686 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 14:39:32.803686 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 14:39:32.803686 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 14:39:32.803686 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 14:39:32.803686 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:39:32.803686 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:39:32.803686 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:39:32.803686 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:39:32.803686 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7b7f84fc-591d-4486-9bc4-74f60752364f could not be found. (HTTP 404) (Request-ID: req-e02f075a-2be6-4833-b02b-48286fef7199) Jul 12 14:39:32.803686 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:39:32.803686 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:32.803686 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:39:32.804697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:32.804697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 14:39:32.804697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 14:39:32.804697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 14:39:32.804697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 14:39:32.804697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 14:39:32.804697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 14:39:32.804697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 14:39:32.804697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 14:39:32.804697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 14:39:32.804697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 14:39:32.804697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 14:39:32.804697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 14:39:32.804697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 14:39:32.804697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 14:39:32.804697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 14:39:32.804697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 14:39:32.804697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 14:39:32.804697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 14:39:32.807138 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:39:32.807138 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:39:32.807138 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:39:32.807138 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:39:32.807138 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7b7f84fc-591d-4486-9bc4-74f60752364f could not be found. Jul 12 14:39:32.807138 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:39:32.807138 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:32.807138 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:39:32.807138 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:32.807138 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:32.807138 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:32.807138 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:32.807138 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:32.807138 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 14:39:32.807138 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 14:39:32.807138 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:32.807138 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:32.807138 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 14:39:32.807138 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:39:32.809758 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7b7f84fc-591d-4486-9bc4-74f60752364f could not be found. Jul 12 14:39:32.809758 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:39:32.809758 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:32.809758 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:39:32.809758 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:32.809758 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:32.809758 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:32.809758 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:39:32.809758 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:39:32.809758 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7b7f84fc-591d-4486-9bc4-74f60752364f could not be found. Jul 12 14:39:32.809758 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:39:32.809758 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-f677a8a2-34ac-4653-847c-c9b9e82bd0e7 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Returning 404 to user: Volume 7b7f84fc-591d-4486-9bc4-74f60752364f could not be found. {{(pid=129980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:32.809758 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-f677a8a2-34ac-4653-847c-c9b9e82bd0e7 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/7b7f84fc-591d-4486-9bc4-74f60752364f" status: 404 len: 109 microversion: 2.1 time: 0.200959 Jul 12 14:39:32.809758 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 14/30] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Jul 12 14:39:32 2022] GET /compute/v2.1/os-volumes/7b7f84fc-591d-4486-9bc4-74f60752364f => generated 109 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:39:32.843079 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-3924c807-5b28-4bcc-81c3-7a108c3a2532 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Calling method '.version_select at 0x7f962dfff9d0>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:32.932697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.wsgi [None req-3924c807-5b28-4bcc-81c3-7a108c3a2532 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] HTTP exception thrown: Volume 7b7f84fc-591d-4486-9bc4-74f60752364f could not be found. Jul 12 14:39:32.934239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-3924c807-5b28-4bcc-81c3-7a108c3a2532 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Request method failure captured: Jul 12 14:39:32.934239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: request: DELETE /compute/v2.1/os-volumes/7b7f84fc-591d-4486-9bc4-74f60752364f HTTP/1.1 Jul 12 14:39:32.934239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept: application/json Jul 12 14:39:32.934239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept-Encoding: identity Jul 12 14:39:32.934239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Connection: close Jul 12 14:39:32.934239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Length: 0 Jul 12 14:39:32.934239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Type: application/json Jul 12 14:39:32.934239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Host: 10.222.0.30 Jul 12 14:39:32.934239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Openstack-System-Scope: None Jul 12 14:39:32.934239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:32.934239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Auth-Token: gAAAAABizYeTrfeSn2kQmY9CC0BibqJo_4F5iYjtUuSEr7strJ81U-mtN7kH5Jy39mSB6B2h4Vzy7Qugq5QIBoPrW1_Dwz1rNwjKdovCG529h7SQffwaqpcYm8fv5WtGSdFwOyS-INoT7vC1CIc22Ny44NFu0AjHU_eOcQmOg8XieU79kfx2wIY Jul 12 14:39:32.934239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Id: None Jul 12 14:39:32.934239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Name: None Jul 12 14:39:32.934239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Identity-Status: Confirmed Jul 12 14:39:32.934239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Is-Admin-Project: True Jul 12 14:39:32.934239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Id: default Jul 12 14:39:32.934239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Name: Default Jul 12 14:39:32.934239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Id: 98f3b8e5987e4daebdcfdd6311032a67 Jul 12 14:39:32.934239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1587033204 Jul 12 14:39:32.934239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Role: member,reader Jul 12 14:39:32.934239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Roles: member,reader Jul 12 14:39:32.944872 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/98f3b8e5987e4daebdcfdd6311032a67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/98f3b8e5987e4daebdcfdd6311032a67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/98f3b8e5987e4daebdcfdd6311032a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_98f3b8e5987e4daebdcfdd6311032a67", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:39:32.944872 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1587033204 Jul 12 14:39:32.944872 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Id: 98f3b8e5987e4daebdcfdd6311032a67 Jul 12 14:39:32.944872 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1587033204 Jul 12 14:39:32.944872 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User: tempest-VolumesSnapshotsTestJSON-1587033204-project Jul 12 14:39:32.944872 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Id: default Jul 12 14:39:32.944872 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Name: Default Jul 12 14:39:32.944872 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Id: d2bb01bd22b14c418d6465441b0646d8 Jul 12 14:39:32.944872 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1587033204-project Jul 12 14:39:32.944872 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: method: Jul 12 14:39:32.944872 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: exception: Volume 7b7f84fc-591d-4486-9bc4-74f60752364f could not be found. Jul 12 14:39:32.944872 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: action_args: {'id': '7b7f84fc-591d-4486-9bc4-74f60752364f'} Jul 12 14:39:32.944872 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:32.945647 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:32.945647 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 14:39:32.945647 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 14:39:32.945647 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 14:39:32.945647 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 14:39:32.945647 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 14:39:32.945647 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 14:39:32.945647 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 14:39:32.945647 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 14:39:32.945647 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 14:39:32.945647 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 14:39:32.945647 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:39:32.945647 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:39:32.945647 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:39:32.945647 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:39:32.945647 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7b7f84fc-591d-4486-9bc4-74f60752364f could not be found. (HTTP 404) (Request-ID: req-986eef08-41c6-44df-8d5a-4a3d55910085) Jul 12 14:39:32.945647 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:39:32.945647 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:32.945647 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:39:32.946569 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:32.946569 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 14:39:32.946569 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 14:39:32.946569 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 14:39:32.946569 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 14:39:32.946569 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 14:39:32.946569 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 14:39:32.946569 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 14:39:32.946569 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 14:39:32.946569 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 14:39:32.946569 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 14:39:32.946569 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 14:39:32.946569 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 14:39:32.946569 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 14:39:32.946569 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 14:39:32.946569 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 14:39:32.946569 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 14:39:32.946569 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 14:39:32.946569 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 14:39:32.947555 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:39:32.947555 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:39:32.947555 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:39:32.947555 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:39:32.947555 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7b7f84fc-591d-4486-9bc4-74f60752364f could not be found. Jul 12 14:39:32.947555 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:39:32.947555 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:32.947555 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:39:32.947555 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:32.947555 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:32.947555 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:32.947555 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:32.947555 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:32.947555 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 14:39:32.947555 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 14:39:32.947555 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:32.947555 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:32.947555 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 14:39:32.947555 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:39:32.948842 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7b7f84fc-591d-4486-9bc4-74f60752364f could not be found. Jul 12 14:39:32.948842 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:39:32.948842 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:32.948842 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:39:32.948842 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:32.948842 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:32.948842 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:32.948842 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:39:32.948842 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:39:32.948842 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7b7f84fc-591d-4486-9bc4-74f60752364f could not be found. Jul 12 14:39:32.948842 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:39:32.948842 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-3924c807-5b28-4bcc-81c3-7a108c3a2532 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Returning 404 to user: Volume 7b7f84fc-591d-4486-9bc4-74f60752364f could not be found. {{(pid=129980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:32.948842 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-3924c807-5b28-4bcc-81c3-7a108c3a2532 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/7b7f84fc-591d-4486-9bc4-74f60752364f" status: 404 len: 109 microversion: 2.1 time: 0.120250 Jul 12 14:39:32.948842 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 15/31] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Jul 12 14:39:32 2022] DELETE /compute/v2.1/os-volumes/7b7f84fc-591d-4486-9bc4-74f60752364f => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:39:32.954885 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-449a9921-1e12-4faa-91d5-59a073237b87 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Calling method '.version_select at 0x7f962e898c10>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:33.013372 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.wsgi [None req-449a9921-1e12-4faa-91d5-59a073237b87 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] HTTP exception thrown: Volume 7b7f84fc-591d-4486-9bc4-74f60752364f could not be found. Jul 12 14:39:33.016425 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-449a9921-1e12-4faa-91d5-59a073237b87 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Request method failure captured: Jul 12 14:39:33.016425 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: request: GET /compute/v2.1/os-volumes/7b7f84fc-591d-4486-9bc4-74f60752364f HTTP/1.1 Jul 12 14:39:33.016425 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept: application/json Jul 12 14:39:33.016425 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept-Encoding: identity Jul 12 14:39:33.016425 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Connection: close Jul 12 14:39:33.016425 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Length: 0 Jul 12 14:39:33.016425 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Type: application/json Jul 12 14:39:33.016425 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Host: 10.222.0.30 Jul 12 14:39:33.016425 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Openstack-System-Scope: None Jul 12 14:39:33.016425 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:33.016425 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Auth-Token: gAAAAABizYeTrfeSn2kQmY9CC0BibqJo_4F5iYjtUuSEr7strJ81U-mtN7kH5Jy39mSB6B2h4Vzy7Qugq5QIBoPrW1_Dwz1rNwjKdovCG529h7SQffwaqpcYm8fv5WtGSdFwOyS-INoT7vC1CIc22Ny44NFu0AjHU_eOcQmOg8XieU79kfx2wIY Jul 12 14:39:33.016425 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Id: None Jul 12 14:39:33.016425 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Name: None Jul 12 14:39:33.016425 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Identity-Status: Confirmed Jul 12 14:39:33.016425 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Is-Admin-Project: True Jul 12 14:39:33.016425 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Id: default Jul 12 14:39:33.016425 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Name: Default Jul 12 14:39:33.016425 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Id: 98f3b8e5987e4daebdcfdd6311032a67 Jul 12 14:39:33.016425 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1587033204 Jul 12 14:39:33.016425 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Role: member,reader Jul 12 14:39:33.016425 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Roles: member,reader Jul 12 14:39:33.017911 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/98f3b8e5987e4daebdcfdd6311032a67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/98f3b8e5987e4daebdcfdd6311032a67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/98f3b8e5987e4daebdcfdd6311032a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_98f3b8e5987e4daebdcfdd6311032a67", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:39:33.017911 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1587033204 Jul 12 14:39:33.017911 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Id: 98f3b8e5987e4daebdcfdd6311032a67 Jul 12 14:39:33.017911 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1587033204 Jul 12 14:39:33.017911 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User: tempest-VolumesSnapshotsTestJSON-1587033204-project Jul 12 14:39:33.017911 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Id: default Jul 12 14:39:33.017911 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Name: Default Jul 12 14:39:33.017911 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Id: d2bb01bd22b14c418d6465441b0646d8 Jul 12 14:39:33.017911 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1587033204-project Jul 12 14:39:33.017911 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: method: Jul 12 14:39:33.017911 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: exception: Volume 7b7f84fc-591d-4486-9bc4-74f60752364f could not be found. Jul 12 14:39:33.017911 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: action_args: {'id': '7b7f84fc-591d-4486-9bc4-74f60752364f'} Jul 12 14:39:33.017911 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:33.018730 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:33.018730 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 14:39:33.018730 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 14:39:33.018730 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 14:39:33.018730 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 14:39:33.018730 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 14:39:33.018730 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 14:39:33.018730 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 14:39:33.018730 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 14:39:33.018730 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 14:39:33.018730 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 14:39:33.018730 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:39:33.018730 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:39:33.018730 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:39:33.018730 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:39:33.018730 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7b7f84fc-591d-4486-9bc4-74f60752364f could not be found. (HTTP 404) (Request-ID: req-d0942a3a-6db4-4a91-b2b6-c3588292c72b) Jul 12 14:39:33.018730 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:39:33.018730 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:33.018730 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:39:33.019898 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:33.019898 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 14:39:33.019898 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 14:39:33.019898 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 14:39:33.019898 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 14:39:33.019898 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 14:39:33.019898 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 14:39:33.019898 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 14:39:33.019898 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 14:39:33.019898 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 14:39:33.019898 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 14:39:33.019898 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 14:39:33.019898 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 14:39:33.019898 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 14:39:33.019898 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 14:39:33.019898 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 14:39:33.019898 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 14:39:33.019898 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 14:39:33.019898 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 14:39:33.021053 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:39:33.021053 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:39:33.021053 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:39:33.021053 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:39:33.021053 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7b7f84fc-591d-4486-9bc4-74f60752364f could not be found. Jul 12 14:39:33.021053 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:39:33.021053 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:33.021053 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:39:33.021053 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:33.021053 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:33.021053 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:33.021053 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:33.021053 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:33.021053 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 14:39:33.021053 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 14:39:33.021053 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:33.021053 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:33.021053 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 14:39:33.021053 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:39:33.022550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7b7f84fc-591d-4486-9bc4-74f60752364f could not be found. Jul 12 14:39:33.022550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:39:33.022550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:33.022550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:39:33.022550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:33.022550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:33.022550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:33.022550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:39:33.022550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:39:33.022550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7b7f84fc-591d-4486-9bc4-74f60752364f could not be found. Jul 12 14:39:33.022550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:39:33.022550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-449a9921-1e12-4faa-91d5-59a073237b87 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] Returning 404 to user: Volume 7b7f84fc-591d-4486-9bc4-74f60752364f could not be found. {{(pid=129980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:33.022550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-449a9921-1e12-4faa-91d5-59a073237b87 tempest-VolumesSnapshotsTestJSON-1587033204 tempest-VolumesSnapshotsTestJSON-1587033204-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/7b7f84fc-591d-4486-9bc4-74f60752364f" status: 404 len: 109 microversion: 2.1 time: 0.067586 Jul 12 14:39:33.022550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 16/32] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Jul 12 14:39:32 2022] GET /compute/v2.1/os-volumes/7b7f84fc-591d-4486-9bc4-74f60752364f => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 14:39:33.083117 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-6ed652f8-2079-485f-bf5e-81dd5c232ef8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Flavor limits 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:39:33.084572 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-6ed652f8-2079-485f-bf5e-81dd5c232ef8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Image limits 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:39:33.085291 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-6ed652f8-2079-485f-bf5e-81dd5c232ef8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Flavor pref 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:39:33.086111 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-6ed652f8-2079-485f-bf5e-81dd5c232ef8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Image pref 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:39:33.087077 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-6ed652f8-2079-485f-bf5e-81dd5c232ef8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:39:33.119555 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6ed652f8-2079-485f-bf5e-81dd5c232ef8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:33.124806 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6ed652f8-2079-485f-bf5e-81dd5c232ef8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:33.125971 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6ed652f8-2079-485f-bf5e-81dd5c232ef8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:33.126565 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6ed652f8-2079-485f-bf5e-81dd5c232ef8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:33.222223 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.quota [None req-6ed652f8-2079-485f-bf5e-81dd5c232ef8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Getting quotas for project fe2b01873d92453599763e5523a862f8. Resources: {'instances', 'cores', 'ram'} {{(pid=129981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:39:33.234590 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.quota [None req-6ed652f8-2079-485f-bf5e-81dd5c232ef8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Getting quotas for user 97f1b1e52a984639a504441e3701b981 and project fe2b01873d92453599763e5523a862f8. Resources: {'instances', 'cores', 'ram'} {{(pid=129981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:39:33.268180 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-6ed652f8-2079-485f-bf5e-81dd5c232ef8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Going to run 1 instances... {{(pid=129981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:39:33.283927 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-6ed652f8-2079-485f-bf5e-81dd5c232ef8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a66ccacb-7b1e-4f51-9eaf-069a356e0fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:39:33.635106 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-6ed652f8-2079-485f-bf5e-81dd5c232ef8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.592213 Jul 12 14:39:33.641723 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 17/33] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Jul 12 14:39:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 3595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:39:33.648347 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ca3c08d8-f2b7-48e2-ae93-8c86e1ef6bc7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:33.649991 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-ca3c08d8-f2b7-48e2-ae93-8c86e1ef6bc7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:34.188260 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ca3c08d8-f2b7-48e2-ae93-8c86e1ef6bc7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:34.216580 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ca3c08d8-f2b7-48e2-ae93-8c86e1ef6bc7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1222 microversion: 2.1 time: 0.573323 Jul 12 14:39:34.225100 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 17/34] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:33 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1222 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:34.659193 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-3e7f440c-9e7e-48b9-adc4-ef05b7381bba tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1591014209", "imageRef": "a66ccacb-7b1e-4f51-9eaf-069a356e0fdb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:34.801855 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.network.neutron [None req-3e7f440c-9e7e-48b9-adc4-ef05b7381bba tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] validate_networks() for [('819820a3-8857-4e62-88e8-410b4a79b856', None, None, None, None, None)] {{(pid=129981) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:39:34.837812 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-1f3f35ab-e523-4805-9b86-389520fac35f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1868530865", "imageRef": "a66ccacb-7b1e-4f51-9eaf-069a356e0fdb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0743c566-7c21-4b95-974f-e2dc9a3ae72e"}], "security_groups": [{"name": "tempest-securitygroup--977877755"}], "key_name": "tempest-keypair-645138716", "user_data": "}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:35.506369 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.network.neutron [None req-1f3f35ab-e523-4805-9b86-389520fac35f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] validate_networks() for [('0743c566-7c21-4b95-974f-e2dc9a3ae72e', None, None, None, None, None)] {{(pid=129980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:39:36.603191 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-3e7f440c-9e7e-48b9-adc4-ef05b7381bba tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Flavor limits 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:39:36.604341 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-3e7f440c-9e7e-48b9-adc4-ef05b7381bba tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Image limits 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:39:36.605028 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-3e7f440c-9e7e-48b9-adc4-ef05b7381bba tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Flavor pref 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:39:36.605699 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-3e7f440c-9e7e-48b9-adc4-ef05b7381bba tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Image pref 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:39:36.607150 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-3e7f440c-9e7e-48b9-adc4-ef05b7381bba tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:39:36.622773 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3e7f440c-9e7e-48b9-adc4-ef05b7381bba tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:36.624318 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3e7f440c-9e7e-48b9-adc4-ef05b7381bba tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:36.625447 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3e7f440c-9e7e-48b9-adc4-ef05b7381bba tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:36.626093 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3e7f440c-9e7e-48b9-adc4-ef05b7381bba tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:36.652411 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.quota [None req-3e7f440c-9e7e-48b9-adc4-ef05b7381bba tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Getting quotas for project fe2b01873d92453599763e5523a862f8. Resources: {'instances', 'cores', 'ram'} {{(pid=129981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:39:36.660424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.quota [None req-3e7f440c-9e7e-48b9-adc4-ef05b7381bba tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Getting quotas for user 97f1b1e52a984639a504441e3701b981 and project fe2b01873d92453599763e5523a862f8. Resources: {'instances', 'cores', 'ram'} {{(pid=129981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:39:36.680985 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-3e7f440c-9e7e-48b9-adc4-ef05b7381bba tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Going to run 1 instances... {{(pid=129981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:39:36.684329 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-3e7f440c-9e7e-48b9-adc4-ef05b7381bba tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a66ccacb-7b1e-4f51-9eaf-069a356e0fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:39:36.915727 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-3e7f440c-9e7e-48b9-adc4-ef05b7381bba tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.263754 Jul 12 14:39:36.929661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 18/35] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Jul 12 14:39:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 2278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:39:37.734167 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-7dcb9779-c4b8-4bb6-8eb7-b4cfbe7fa19b tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1524835983", "imageRef": "a66ccacb-7b1e-4f51-9eaf-069a356e0fdb", "flavorRef": "452", "networks": [{"uuid": "8f2c907b-451f-45e4-9802-40ef4e3361a2"}]}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:37.838429 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.network.neutron [None req-7dcb9779-c4b8-4bb6-8eb7-b4cfbe7fa19b tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] validate_networks() for [('8f2c907b-451f-45e4-9802-40ef4e3361a2', None, None, None, None, None)] {{(pid=129981) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:39:38.128309 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-1f3f35ab-e523-4805-9b86-389520fac35f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Flavor limits 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:39:38.128862 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-1f3f35ab-e523-4805-9b86-389520fac35f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Image limits 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:39:38.129230 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-1f3f35ab-e523-4805-9b86-389520fac35f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Flavor pref 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:39:38.129645 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-1f3f35ab-e523-4805-9b86-389520fac35f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Image pref 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:39:38.130057 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-1f3f35ab-e523-4805-9b86-389520fac35f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:39:38.154413 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1f3f35ab-e523-4805-9b86-389520fac35f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:38.167691 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1f3f35ab-e523-4805-9b86-389520fac35f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:38.167691 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1f3f35ab-e523-4805-9b86-389520fac35f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:38.167691 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1f3f35ab-e523-4805-9b86-389520fac35f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:38.247194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-1f3f35ab-e523-4805-9b86-389520fac35f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Getting quotas for project 52569bf4eba24c2a9fa0ef8c26b8b22d. Resources: {'instances', 'cores', 'ram'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:39:38.258018 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-1f3f35ab-e523-4805-9b86-389520fac35f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Getting quotas for user 8f118c0ba8494e6e9f5a4488ebf8d220 and project 52569bf4eba24c2a9fa0ef8c26b8b22d. Resources: {'instances', 'cores', 'ram'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:39:38.308548 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-1f3f35ab-e523-4805-9b86-389520fac35f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Going to run 1 instances... {{(pid=129980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:39:38.319409 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-1f3f35ab-e523-4805-9b86-389520fac35f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a66ccacb-7b1e-4f51-9eaf-069a356e0fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:39:38.519773 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-1f3f35ab-e523-4805-9b86-389520fac35f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.687270 Jul 12 14:39:38.528528 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 18/36] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Jul 12 14:39:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 3697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:39:38.537028 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-47cd467a-f8d7-4b5c-abda-13fb8b7a25f0 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:38.539597 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-47cd467a-f8d7-4b5c-abda-13fb8b7a25f0 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:38.891649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-47cd467a-f8d7-4b5c-abda-13fb8b7a25f0 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:38.894931 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-7dcb9779-c4b8-4bb6-8eb7-b4cfbe7fa19b tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Flavor limits 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:39:38.895520 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-7dcb9779-c4b8-4bb6-8eb7-b4cfbe7fa19b tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Image limits 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:39:38.896517 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-7dcb9779-c4b8-4bb6-8eb7-b4cfbe7fa19b tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Flavor pref 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:39:38.900033 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-7dcb9779-c4b8-4bb6-8eb7-b4cfbe7fa19b tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Image pref 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:39:38.900579 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-7dcb9779-c4b8-4bb6-8eb7-b4cfbe7fa19b tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:39:38.911063 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-47cd467a-f8d7-4b5c-abda-13fb8b7a25f0 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1222 microversion: 2.1 time: 0.380771 Jul 12 14:39:38.911919 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 19/37] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:38 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1222 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:38.916772 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7dcb9779-c4b8-4bb6-8eb7-b4cfbe7fa19b tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:38.917256 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7dcb9779-c4b8-4bb6-8eb7-b4cfbe7fa19b tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:38.918252 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7dcb9779-c4b8-4bb6-8eb7-b4cfbe7fa19b tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:38.918695 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7dcb9779-c4b8-4bb6-8eb7-b4cfbe7fa19b tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:38.927577 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-9bea9736-5c11-4ec4-ab6a-7b18ef8f3fae tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:38.931744 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-9bea9736-5c11-4ec4-ab6a-7b18ef8f3fae tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:38.939627 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.quota [None req-7dcb9779-c4b8-4bb6-8eb7-b4cfbe7fa19b tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Getting quotas for project 165d7892df2f450d927c92d71cd96f29. Resources: {'instances', 'cores', 'ram'} {{(pid=129981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:39:38.947497 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.quota [None req-7dcb9779-c4b8-4bb6-8eb7-b4cfbe7fa19b tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Getting quotas for user 83e06ab7cd924e07a79efaafa078a174 and project 165d7892df2f450d927c92d71cd96f29. Resources: {'instances', 'cores', 'ram'} {{(pid=129981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:39:38.968792 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-7dcb9779-c4b8-4bb6-8eb7-b4cfbe7fa19b tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Going to run 1 instances... {{(pid=129981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:39:38.971886 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-7dcb9779-c4b8-4bb6-8eb7-b4cfbe7fa19b tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a66ccacb-7b1e-4f51-9eaf-069a356e0fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:39:38.996132 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-9bea9736-5c11-4ec4-ab6a-7b18ef8f3fae tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:39.003311 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-9bea9736-5c11-4ec4-ab6a-7b18ef8f3fae tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1237 microversion: 2.1 time: 0.080561 Jul 12 14:39:39.004447 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 20/38] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:38 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1237 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:39.015151 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-c55c7740-e8b6-4de8-8950-f04a6f43d038 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1381245562", "imageRef": "a66ccacb-7b1e-4f51-9eaf-069a356e0fdb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c65826f1-3839-4331-9c1c-eca62ef0fb22"}], "security_groups": [{"name": "tempest-securitygroup--477065943"}], "key_name": "tempest-keypair-1576898000", "user_data": "}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:39.136316 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.network.neutron [None req-c55c7740-e8b6-4de8-8950-f04a6f43d038 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] validate_networks() for [('c65826f1-3839-4331-9c1c-eca62ef0fb22', None, None, None, None, None)] {{(pid=129980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:39:39.204436 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-7dcb9779-c4b8-4bb6-8eb7-b4cfbe7fa19b tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.273856 Jul 12 14:39:39.205491 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Jul 12 14:39:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:39:39.222838 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-f28d1d9e-243b-4424-b257-4562b9b9f316 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:39.225396 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-f28d1d9e-243b-4424-b257-4562b9b9f316 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:39.352823 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-f28d1d9e-243b-4424-b257-4562b9b9f316 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:39.376886 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-f28d1d9e-243b-4424-b257-4562b9b9f316 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1215 microversion: 2.1 time: 0.164993 Jul 12 14:39:39.377636 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 20/40] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:39 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1215 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:39.934423 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-90b13106-7407-47ff-a70e-61c0dc945e7d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:39.934423 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-90b13106-7407-47ff-a70e-61c0dc945e7d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:39.965239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-c55c7740-e8b6-4de8-8950-f04a6f43d038 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Flavor limits 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:39:39.965239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-c55c7740-e8b6-4de8-8950-f04a6f43d038 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Image limits 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:39:39.965239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-c55c7740-e8b6-4de8-8950-f04a6f43d038 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Flavor pref 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:39:39.965239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-c55c7740-e8b6-4de8-8950-f04a6f43d038 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Image pref 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:39:39.965239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-c55c7740-e8b6-4de8-8950-f04a6f43d038 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:39:39.965737 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-90b13106-7407-47ff-a70e-61c0dc945e7d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:39.965737 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-90b13106-7407-47ff-a70e-61c0dc945e7d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:39.966016 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-90b13106-7407-47ff-a70e-61c0dc945e7d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:39.966726 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-90b13106-7407-47ff-a70e-61c0dc945e7d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:39.987090 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c55c7740-e8b6-4de8-8950-f04a6f43d038 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:39.987530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c55c7740-e8b6-4de8-8950-f04a6f43d038 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:39.988418 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c55c7740-e8b6-4de8-8950-f04a6f43d038 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:39.991545 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c55c7740-e8b6-4de8-8950-f04a6f43d038 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:40.042980 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-c55c7740-e8b6-4de8-8950-f04a6f43d038 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Getting quotas for project 3f550f8d11a74b8da5ad84607b79ac37. Resources: {'instances', 'cores', 'ram'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:39:40.052718 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-c55c7740-e8b6-4de8-8950-f04a6f43d038 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Getting quotas for user a760d437b597441fa9a4595995c5bc6f and project 3f550f8d11a74b8da5ad84607b79ac37. Resources: {'instances', 'cores', 'ram'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:39:40.091463 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-c55c7740-e8b6-4de8-8950-f04a6f43d038 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Going to run 1 instances... {{(pid=129980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:39:40.092332 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-c55c7740-e8b6-4de8-8950-f04a6f43d038 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a66ccacb-7b1e-4f51-9eaf-069a356e0fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:39:40.364206 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-c55c7740-e8b6-4de8-8950-f04a6f43d038 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.349305 Jul 12 14:39:40.373634 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 21/41] 10.222.0.30 () {62 vars in 1187 bytes} [Tue Jul 12 14:39:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 1368 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 14:39:40.401474 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-32192023-5631-46fc-801e-733d885902ff tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:40.402438 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-32192023-5631-46fc-801e-733d885902ff tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:40.439578 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-32192023-5631-46fc-801e-733d885902ff tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:40.440036 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-32192023-5631-46fc-801e-733d885902ff tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:40.440822 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-32192023-5631-46fc-801e-733d885902ff tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:40.457127 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-32192023-5631-46fc-801e-733d885902ff tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:40.501637 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-90b13106-7407-47ff-a70e-61c0dc945e7d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:40.520439 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-90b13106-7407-47ff-a70e-61c0dc945e7d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1218 microversion: 2.1 time: 0.593470 Jul 12 14:39:40.526390 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 21/42] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:39 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1218 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:40.536461 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-0942ca6d-30fd-422f-a0e0-aae9c6b2a556 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:40.538237 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-0942ca6d-30fd-422f-a0e0-aae9c6b2a556 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:40.659466 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-0942ca6d-30fd-422f-a0e0-aae9c6b2a556 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:40.668332 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-0942ca6d-30fd-422f-a0e0-aae9c6b2a556 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:40.675565 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-0942ca6d-30fd-422f-a0e0-aae9c6b2a556 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:40.679128 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-0942ca6d-30fd-422f-a0e0-aae9c6b2a556 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1282 microversion: 2.20 time: 0.151426 Jul 12 14:39:40.682549 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 22/43] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:40 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1282 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:39:40.697068 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-5c2bdb47-d394-42f2-9ed9-160f83bedd95 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:40.697068 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-5c2bdb47-d394-42f2-9ed9-160f83bedd95 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:40.829099 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-32192023-5631-46fc-801e-733d885902ff tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:40.831040 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-5c2bdb47-d394-42f2-9ed9-160f83bedd95 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:40.838210 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-5c2bdb47-d394-42f2-9ed9-160f83bedd95 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1215 microversion: 2.1 time: 0.153859 Jul 12 14:39:40.839320 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 23/44] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:40 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1215 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:40.846929 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-32192023-5631-46fc-801e-733d885902ff tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1241 microversion: 2.1 time: 0.471645 Jul 12 14:39:40.848072 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 22/45] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:40 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1241 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:41.545376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-43e2286c-ca85-465b-bd7f-6a6a47d3f007 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:41.546524 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-43e2286c-ca85-465b-bd7f-6a6a47d3f007 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:41.561586 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-43e2286c-ca85-465b-bd7f-6a6a47d3f007 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:41.562046 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-43e2286c-ca85-465b-bd7f-6a6a47d3f007 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:41.562832 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-43e2286c-ca85-465b-bd7f-6a6a47d3f007 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:41.572715 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-43e2286c-ca85-465b-bd7f-6a6a47d3f007 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:41.704718 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ac8af9b9-a98d-4031-91c5-516b9ac41e31 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:41.704718 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-ac8af9b9-a98d-4031-91c5-516b9ac41e31 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:41.805216 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-43e2286c-ca85-465b-bd7f-6a6a47d3f007 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:41.815639 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-43e2286c-ca85-465b-bd7f-6a6a47d3f007 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1282 microversion: 2.1 time: 0.275491 Jul 12 14:39:41.825595 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 24/46] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:41 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1282 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:41.845558 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ac8af9b9-a98d-4031-91c5-516b9ac41e31 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:41.869777 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ac8af9b9-a98d-4031-91c5-516b9ac41e31 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:41.869880 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-ea04a823-d847-491b-9fac-53eeb0c70337 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:41.869956 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ac8af9b9-a98d-4031-91c5-516b9ac41e31 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:41.870052 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-ea04a823-d847-491b-9fac-53eeb0c70337 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:41.871404 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ac8af9b9-a98d-4031-91c5-516b9ac41e31 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1282 microversion: 2.20 time: 0.174564 Jul 12 14:39:41.883173 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 23/47] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:41 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1282 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:39:41.888744 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ea04a823-d847-491b-9fac-53eeb0c70337 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:41.889822 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ea04a823-d847-491b-9fac-53eeb0c70337 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:41.890852 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ea04a823-d847-491b-9fac-53eeb0c70337 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:41.891443 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ea04a823-d847-491b-9fac-53eeb0c70337 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:41.895955 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-fa65923c-930b-4fd5-9b0a-23151345c5db tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:41.899245 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-fa65923c-930b-4fd5-9b0a-23151345c5db tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:41.923453 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fa65923c-930b-4fd5-9b0a-23151345c5db tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:41.927840 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fa65923c-930b-4fd5-9b0a-23151345c5db tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:41.929119 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fa65923c-930b-4fd5-9b0a-23151345c5db tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:41.929970 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fa65923c-930b-4fd5-9b0a-23151345c5db tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:42.052906 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-ea04a823-d847-491b-9fac-53eeb0c70337 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:42.071619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-ea04a823-d847-491b-9fac-53eeb0c70337 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1233 microversion: 2.1 time: 0.211425 Jul 12 14:39:42.075935 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 25/48] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:41 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1233 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:42.165613 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-fa65923c-930b-4fd5-9b0a-23151345c5db tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:42.187854 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-fa65923c-930b-4fd5-9b0a-23151345c5db tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1211 microversion: 2.1 time: 0.309080 Jul 12 14:39:42.189563 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 24/49] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:41 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1211 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:42.842276 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-33bc2b2c-97f9-41b4-bb4c-26ccf51af140 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:42.843516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-33bc2b2c-97f9-41b4-bb4c-26ccf51af140 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:42.859569 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-33bc2b2c-97f9-41b4-bb4c-26ccf51af140 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:42.860318 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-33bc2b2c-97f9-41b4-bb4c-26ccf51af140 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:42.862614 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-33bc2b2c-97f9-41b4-bb4c-26ccf51af140 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:42.867381 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-33bc2b2c-97f9-41b4-bb4c-26ccf51af140 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:42.892452 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-5e93af17-9480-4ea5-afa8-bd6c8e057544 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:42.893806 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-5e93af17-9480-4ea5-afa8-bd6c8e057544 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:42.911222 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5e93af17-9480-4ea5-afa8-bd6c8e057544 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:42.911687 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5e93af17-9480-4ea5-afa8-bd6c8e057544 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:42.913168 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5e93af17-9480-4ea5-afa8-bd6c8e057544 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:42.913658 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5e93af17-9480-4ea5-afa8-bd6c8e057544 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:43.107706 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-33bc2b2c-97f9-41b4-bb4c-26ccf51af140 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:43.116309 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-33bc2b2c-97f9-41b4-bb4c-26ccf51af140 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1280 microversion: 2.1 time: 0.280380 Jul 12 14:39:43.117405 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 26/50] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:42 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1280 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:43.145238 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-52b46121-94d8-4270-b2e6-62e63360c880 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:43.146115 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-52b46121-94d8-4270-b2e6-62e63360c880 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:43.147398 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-5e93af17-9480-4ea5-afa8-bd6c8e057544 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:43.160603 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-5e93af17-9480-4ea5-afa8-bd6c8e057544 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:43.162257 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-5e93af17-9480-4ea5-afa8-bd6c8e057544 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:43.165839 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-5e93af17-9480-4ea5-afa8-bd6c8e057544 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1286 microversion: 2.20 time: 0.276089 Jul 12 14:39:43.166409 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 25/51] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:42 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1286 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:39:43.172505 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-52b46121-94d8-4270-b2e6-62e63360c880 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:43.172505 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-52b46121-94d8-4270-b2e6-62e63360c880 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:43.172505 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-52b46121-94d8-4270-b2e6-62e63360c880 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:43.172505 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-52b46121-94d8-4270-b2e6-62e63360c880 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:43.206847 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-911d1f98-229e-4e35-b56e-9082e2a06928 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:43.208069 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-911d1f98-229e-4e35-b56e-9082e2a06928 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:43.222763 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-911d1f98-229e-4e35-b56e-9082e2a06928 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:43.225567 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-911d1f98-229e-4e35-b56e-9082e2a06928 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:43.226475 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-911d1f98-229e-4e35-b56e-9082e2a06928 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:43.226921 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-911d1f98-229e-4e35-b56e-9082e2a06928 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:43.362671 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-52b46121-94d8-4270-b2e6-62e63360c880 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:43.378977 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-52b46121-94d8-4270-b2e6-62e63360c880 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1297 microversion: 2.1 time: 0.258929 Jul 12 14:39:43.383470 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 27/52] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:43 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1297 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:43.401953 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-911d1f98-229e-4e35-b56e-9082e2a06928 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:43.414191 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-911d1f98-229e-4e35-b56e-9082e2a06928 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1267 microversion: 2.1 time: 0.212965 Jul 12 14:39:43.424259 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 26/53] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:43 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:39:44.143842 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-a6a738b9-df54-4648-ab2b-25b87d89fe12 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:44.145381 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-a6a738b9-df54-4648-ab2b-25b87d89fe12 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:44.169110 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a6a738b9-df54-4648-ab2b-25b87d89fe12 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:44.169673 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a6a738b9-df54-4648-ab2b-25b87d89fe12 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:44.170811 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a6a738b9-df54-4648-ab2b-25b87d89fe12 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:44.171252 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a6a738b9-df54-4648-ab2b-25b87d89fe12 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:44.199201 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0346d49c-80ca-44e0-8829-303c8b7d6859 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:44.201705 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-0346d49c-80ca-44e0-8829-303c8b7d6859 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:44.210751 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0346d49c-80ca-44e0-8829-303c8b7d6859 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:44.215235 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0346d49c-80ca-44e0-8829-303c8b7d6859 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:44.221894 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0346d49c-80ca-44e0-8829-303c8b7d6859 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:44.222690 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0346d49c-80ca-44e0-8829-303c8b7d6859 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:44.583728 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-0346d49c-80ca-44e0-8829-303c8b7d6859 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:44.592435 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-0346d49c-80ca-44e0-8829-303c8b7d6859 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:44.594145 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-0346d49c-80ca-44e0-8829-303c8b7d6859 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:44.595105 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-0346d49c-80ca-44e0-8829-303c8b7d6859 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1334 microversion: 2.20 time: 0.411785 Jul 12 14:39:44.595675 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 27/54] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:44 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1334 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:39:44.603129 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-89fc604a-55be-41d9-88eb-d23afd6db88f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:44.605548 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-89fc604a-55be-41d9-88eb-d23afd6db88f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:44.615602 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-89fc604a-55be-41d9-88eb-d23afd6db88f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:44.616127 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-89fc604a-55be-41d9-88eb-d23afd6db88f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:44.617134 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-89fc604a-55be-41d9-88eb-d23afd6db88f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:44.617770 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-89fc604a-55be-41d9-88eb-d23afd6db88f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:44.657539 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-a6a738b9-df54-4648-ab2b-25b87d89fe12 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:44.667327 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-a6a738b9-df54-4648-ab2b-25b87d89fe12 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.536622 Jul 12 14:39:44.669068 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 28/55] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:44 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:44.675668 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-ff636fa6-8abd-46b9-833e-6dff363c0b02 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:44.676286 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-ff636fa6-8abd-46b9-833e-6dff363c0b02 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:44.709393 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ff636fa6-8abd-46b9-833e-6dff363c0b02 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:44.710768 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ff636fa6-8abd-46b9-833e-6dff363c0b02 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:44.711971 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ff636fa6-8abd-46b9-833e-6dff363c0b02 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:44.712745 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ff636fa6-8abd-46b9-833e-6dff363c0b02 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:44.724558 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-89fc604a-55be-41d9-88eb-d23afd6db88f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:44.733522 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-89fc604a-55be-41d9-88eb-d23afd6db88f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1295 microversion: 2.1 time: 0.136734 Jul 12 14:39:44.736711 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 28/56] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:44 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1295 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:44.812919 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-ff636fa6-8abd-46b9-833e-6dff363c0b02 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:44.822925 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-ff636fa6-8abd-46b9-833e-6dff363c0b02 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1285 microversion: 2.1 time: 0.152088 Jul 12 14:39:44.825598 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 29/57] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:44 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1285 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:45.616406 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-e3460f2e-7580-4089-9e2f-c5f9d7384455 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:45.617046 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-e3460f2e-7580-4089-9e2f-c5f9d7384455 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:45.624142 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e3460f2e-7580-4089-9e2f-c5f9d7384455 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:45.624595 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e3460f2e-7580-4089-9e2f-c5f9d7384455 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:45.625390 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e3460f2e-7580-4089-9e2f-c5f9d7384455 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:45.625829 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e3460f2e-7580-4089-9e2f-c5f9d7384455 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:45.684615 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-a6ad91d5-b024-45ba-8098-97bb47e24c72 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:45.686363 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-a6ad91d5-b024-45ba-8098-97bb47e24c72 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:45.692909 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-e3460f2e-7580-4089-9e2f-c5f9d7384455 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:45.693952 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a6ad91d5-b024-45ba-8098-97bb47e24c72 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:45.694509 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a6ad91d5-b024-45ba-8098-97bb47e24c72 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:45.695390 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a6ad91d5-b024-45ba-8098-97bb47e24c72 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:45.695958 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a6ad91d5-b024-45ba-8098-97bb47e24c72 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:45.705961 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-e3460f2e-7580-4089-9e2f-c5f9d7384455 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:45.709533 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-e3460f2e-7580-4089-9e2f-c5f9d7384455 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:45.711998 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-e3460f2e-7580-4089-9e2f-c5f9d7384455 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1334 microversion: 2.20 time: 0.098866 Jul 12 14:39:45.713850 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 29/58] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:45 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1334 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:39:45.760169 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-b9210769-5950-4b7f-9c29-6b580f500283 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:45.762023 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-b9210769-5950-4b7f-9c29-6b580f500283 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:45.770051 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b9210769-5950-4b7f-9c29-6b580f500283 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:45.770908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b9210769-5950-4b7f-9c29-6b580f500283 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:45.771762 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b9210769-5950-4b7f-9c29-6b580f500283 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:45.772379 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b9210769-5950-4b7f-9c29-6b580f500283 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:45.852417 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-b9210769-5950-4b7f-9c29-6b580f500283 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:45.860422 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-b9210769-5950-4b7f-9c29-6b580f500283 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1295 microversion: 2.1 time: 0.104227 Jul 12 14:39:45.861015 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 30/59] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:45 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1295 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:39:45.865591 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-49fb67b2-3b4d-4b83-ba68-95b64aa83c21 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:45.866196 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-49fb67b2-3b4d-4b83-ba68-95b64aa83c21 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:45.873378 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-49fb67b2-3b4d-4b83-ba68-95b64aa83c21 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:45.874461 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-49fb67b2-3b4d-4b83-ba68-95b64aa83c21 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:45.875657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-49fb67b2-3b4d-4b83-ba68-95b64aa83c21 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:45.876203 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-49fb67b2-3b4d-4b83-ba68-95b64aa83c21 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:45.887544 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-a6ad91d5-b024-45ba-8098-97bb47e24c72 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:45.896075 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-a6ad91d5-b024-45ba-8098-97bb47e24c72 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.215331 Jul 12 14:39:45.896668 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 30/60] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:45 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:39:45.944627 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-49fb67b2-3b4d-4b83-ba68-95b64aa83c21 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:45.953414 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-49fb67b2-3b4d-4b83-ba68-95b64aa83c21 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1285 microversion: 2.1 time: 0.091292 Jul 12 14:39:45.953996 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 31/61] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:45 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:46.730321 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-78a99611-18db-4422-af76-4be0dd5e9443 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:46.732462 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-78a99611-18db-4422-af76-4be0dd5e9443 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:46.746099 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-78a99611-18db-4422-af76-4be0dd5e9443 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:46.746538 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-78a99611-18db-4422-af76-4be0dd5e9443 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:46.747315 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-78a99611-18db-4422-af76-4be0dd5e9443 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:46.747804 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-78a99611-18db-4422-af76-4be0dd5e9443 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:46.880191 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-78a99611-18db-4422-af76-4be0dd5e9443 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:46.880523 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-79fcdb5a-3444-4eb1-8361-b0cc4e29d59a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:46.880523 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-79fcdb5a-3444-4eb1-8361-b0cc4e29d59a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:46.891659 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-78a99611-18db-4422-af76-4be0dd5e9443 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:46.893396 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-78a99611-18db-4422-af76-4be0dd5e9443 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:46.893710 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-79fcdb5a-3444-4eb1-8361-b0cc4e29d59a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:46.894231 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-79fcdb5a-3444-4eb1-8361-b0cc4e29d59a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:46.895777 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-78a99611-18db-4422-af76-4be0dd5e9443 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1342 microversion: 2.20 time: 0.168788 Jul 12 14:39:46.901612 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-79fcdb5a-3444-4eb1-8361-b0cc4e29d59a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:46.903613 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-79fcdb5a-3444-4eb1-8361-b0cc4e29d59a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:46.908244 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 31/62] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:46 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1342 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:39:46.914777 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-60b2c11c-9005-49a8-89e7-214e0952bce1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:46.915660 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-60b2c11c-9005-49a8-89e7-214e0952bce1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:46.933316 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-60b2c11c-9005-49a8-89e7-214e0952bce1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:46.933937 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-60b2c11c-9005-49a8-89e7-214e0952bce1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:46.935491 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-60b2c11c-9005-49a8-89e7-214e0952bce1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:46.936122 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-60b2c11c-9005-49a8-89e7-214e0952bce1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:47.226746 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-79fcdb5a-3444-4eb1-8361-b0cc4e29d59a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:47.233037 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-79fcdb5a-3444-4eb1-8361-b0cc4e29d59a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1295 microversion: 2.1 time: 0.360022 Jul 12 14:39:47.233766 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 32/63] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:46 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1295 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:47.250632 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-bc4cb377-5c24-4892-8071-f691d73d4826 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:47.251393 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-bc4cb377-5c24-4892-8071-f691d73d4826 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:47.258270 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bc4cb377-5c24-4892-8071-f691d73d4826 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:47.258722 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bc4cb377-5c24-4892-8071-f691d73d4826 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:47.261572 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bc4cb377-5c24-4892-8071-f691d73d4826 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:47.261572 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bc4cb377-5c24-4892-8071-f691d73d4826 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:47.689266 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-bc4cb377-5c24-4892-8071-f691d73d4826 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:47.689266 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-bc4cb377-5c24-4892-8071-f691d73d4826 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1273 microversion: 2.1 time: 0.242471 Jul 12 14:39:47.689266 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 33/64] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:47 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1273 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:47.691429 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-60b2c11c-9005-49a8-89e7-214e0952bce1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:47.691429 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-60b2c11c-9005-49a8-89e7-214e0952bce1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.589699 Jul 12 14:39:47.691429 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 32/65] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:46 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:47.918091 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-93ca7b98-0e3c-46e3-90bc-41bbf5cd2fdf tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:47.918971 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-93ca7b98-0e3c-46e3-90bc-41bbf5cd2fdf tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:47.931003 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:47.935980 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-93ca7b98-0e3c-46e3-90bc-41bbf5cd2fdf tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:47.946834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-93ca7b98-0e3c-46e3-90bc-41bbf5cd2fdf tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:47.946834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-93ca7b98-0e3c-46e3-90bc-41bbf5cd2fdf tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:47.946834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-93ca7b98-0e3c-46e3-90bc-41bbf5cd2fdf tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:48.119151 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-93ca7b98-0e3c-46e3-90bc-41bbf5cd2fdf tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:48.136253 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-93ca7b98-0e3c-46e3-90bc-41bbf5cd2fdf tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:48.142561 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-93ca7b98-0e3c-46e3-90bc-41bbf5cd2fdf tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:48.147519 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-93ca7b98-0e3c-46e3-90bc-41bbf5cd2fdf tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1340 microversion: 2.20 time: 0.233036 Jul 12 14:39:48.151746 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 34/66] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:47 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1340 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:39:48.255845 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-dafa89ef-17da-4e11-a32a-1e6716ab1394 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:48.257619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-dafa89ef-17da-4e11-a32a-1e6716ab1394 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:48.268580 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-dafa89ef-17da-4e11-a32a-1e6716ab1394 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:48.269261 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-dafa89ef-17da-4e11-a32a-1e6716ab1394 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:48.270472 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-dafa89ef-17da-4e11-a32a-1e6716ab1394 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:48.271522 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-dafa89ef-17da-4e11-a32a-1e6716ab1394 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:48.629616 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-dafa89ef-17da-4e11-a32a-1e6716ab1394 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:48.645501 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-dafa89ef-17da-4e11-a32a-1e6716ab1394 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1295 microversion: 2.1 time: 0.389544 Jul 12 14:39:48.646724 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 33/67] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:48 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1295 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:48.709296 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-bbe90737-b90e-4665-8cfb-b382f59c8746 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:48.709817 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-1d697846-1d9a-47c1-b2b9-2b1a5fc96d10 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:48.710440 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-1d697846-1d9a-47c1-b2b9-2b1a5fc96d10 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:48.710697 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-bbe90737-b90e-4665-8cfb-b382f59c8746 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:48.722140 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1d697846-1d9a-47c1-b2b9-2b1a5fc96d10 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:48.722503 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1d697846-1d9a-47c1-b2b9-2b1a5fc96d10 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:48.726287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1d697846-1d9a-47c1-b2b9-2b1a5fc96d10 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:48.726871 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bbe90737-b90e-4665-8cfb-b382f59c8746 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:48.727484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1d697846-1d9a-47c1-b2b9-2b1a5fc96d10 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:48.727829 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bbe90737-b90e-4665-8cfb-b382f59c8746 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:48.728778 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bbe90737-b90e-4665-8cfb-b382f59c8746 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:48.731778 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bbe90737-b90e-4665-8cfb-b382f59c8746 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:48.879538 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-bbe90737-b90e-4665-8cfb-b382f59c8746 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:48.891428 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-bbe90737-b90e-4665-8cfb-b382f59c8746 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1273 microversion: 2.1 time: 0.186512 Jul 12 14:39:48.894916 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 34/68] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:48 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1273 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:39:49.163587 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell0:SELECT=6 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:49.169094 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-b73aea85-8650-44d2-a561-edf2f343c000 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:49.169811 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-b73aea85-8650-44d2-a561-edf2f343c000 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:49.179463 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b73aea85-8650-44d2-a561-edf2f343c000 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:49.179963 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b73aea85-8650-44d2-a561-edf2f343c000 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:49.180949 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b73aea85-8650-44d2-a561-edf2f343c000 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:49.181308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b73aea85-8650-44d2-a561-edf2f343c000 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:49.903287 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-b73aea85-8650-44d2-a561-edf2f343c000 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:49.933935 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-b73aea85-8650-44d2-a561-edf2f343c000 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:49.940433 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-b73aea85-8650-44d2-a561-edf2f343c000 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:49.941769 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-b73aea85-8650-44d2-a561-edf2f343c000 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1340 microversion: 2.20 time: 0.778976 Jul 12 14:39:49.945239 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 35/69] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:49 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1340 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:39:49.955988 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-1eae3247-abd3-4de5-b7cd-9021ec72bba4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:49.960650 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-1eae3247-abd3-4de5-b7cd-9021ec72bba4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:49.975892 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1eae3247-abd3-4de5-b7cd-9021ec72bba4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:49.978976 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1eae3247-abd3-4de5-b7cd-9021ec72bba4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:49.980414 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1eae3247-abd3-4de5-b7cd-9021ec72bba4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:49.982232 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1eae3247-abd3-4de5-b7cd-9021ec72bba4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:49.983303 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-1d697846-1d9a-47c1-b2b9-2b1a5fc96d10 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:49.995480 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-1d697846-1d9a-47c1-b2b9-2b1a5fc96d10 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 1.295218 Jul 12 14:39:50.007221 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 35/70] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:48 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:50.013404 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-23ba8ed7-d50b-4fc5-8965-14b1b27b0dd7 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:50.015234 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-23ba8ed7-d50b-4fc5-8965-14b1b27b0dd7 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:50.025322 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell0:SELECT=4 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:50.028496 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-23ba8ed7-d50b-4fc5-8965-14b1b27b0dd7 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:50.030231 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-23ba8ed7-d50b-4fc5-8965-14b1b27b0dd7 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:50.031716 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-23ba8ed7-d50b-4fc5-8965-14b1b27b0dd7 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:50.032558 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-23ba8ed7-d50b-4fc5-8965-14b1b27b0dd7 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:50.835799 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell0:SELECT=24 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:51.020404 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-23ba8ed7-d50b-4fc5-8965-14b1b27b0dd7 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:51.034612 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-23ba8ed7-d50b-4fc5-8965-14b1b27b0dd7 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1315 microversion: 2.1 time: 1.025648 Jul 12 14:39:51.035850 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 36/71] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:50 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1315 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:51.179730 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-1eae3247-abd3-4de5-b7cd-9021ec72bba4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:51.190137 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-1eae3247-abd3-4de5-b7cd-9021ec72bba4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 1.243738 Jul 12 14:39:51.195351 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 36/72] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:49 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:51.211938 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-54316330-f8b9-464f-8936-4b8004bcea96 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:51.212985 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-54316330-f8b9-464f-8936-4b8004bcea96 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:51.236839 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-54316330-f8b9-464f-8936-4b8004bcea96 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:51.239206 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-54316330-f8b9-464f-8936-4b8004bcea96 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:51.242708 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-54316330-f8b9-464f-8936-4b8004bcea96 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:51.243165 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-54316330-f8b9-464f-8936-4b8004bcea96 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:51.350118 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-81761287-50db-4a67-92b4-459f7b92fe47 req-ea9ad394-56b5-495b-bb3c-92c408c09f3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c32aaf0-6aa0-4298-aa4b-a285af8940c7", "tag": "148d0905-282d-448c-899b-1f113dada0e4"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:51.383078 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-81761287-50db-4a67-92b4-459f7b92fe47 req-ea9ad394-56b5-495b-bb3c-92c408c09f3d service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:51.383553 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-81761287-50db-4a67-92b4-459f7b92fe47 req-ea9ad394-56b5-495b-bb3c-92c408c09f3d service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:51.406272 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-81761287-50db-4a67-92b4-459f7b92fe47 req-ea9ad394-56b5-495b-bb3c-92c408c09f3d service nova] Creating event network-changed:148d0905-282d-448c-899b-1f113dada0e4 for instance 4c32aaf0-6aa0-4298-aa4b-a285af8940c7 on hv-cinder-82002 Jul 12 14:39:51.407000 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-81761287-50db-4a67-92b4-459f7b92fe47 req-ea9ad394-56b5-495b-bb3c-92c408c09f3d service nova] Acquired lock "compute-rpcapi-router" {{(pid=129980) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 12 14:39:51.408269 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f7f08610-af41-462b-9057-1064674eab53 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:51.408959 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f7f08610-af41-462b-9057-1064674eab53 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:51.410292 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f7f08610-af41-462b-9057-1064674eab53 None None] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:51.417091 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f7f08610-af41-462b-9057-1064674eab53 None None] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:51.424967 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.compute.rpcapi [None req-f7f08610-af41-462b-9057-1064674eab53 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 12 14:39:51.426406 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f7f08610-af41-462b-9057-1064674eab53 None None] Releasing lock "compute-rpcapi-router" {{(pid=129980) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 12 14:39:51.445283 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-f7f08610-af41-462b-9057-1064674eab53 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.397394 Jul 12 14:39:51.446289 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 37/73] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:51.453479 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-e994f0cf-7b43-4b13-9dd5-da6d14f171b3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:51.454733 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-e994f0cf-7b43-4b13-9dd5-da6d14f171b3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:51.462358 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e994f0cf-7b43-4b13-9dd5-da6d14f171b3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:51.463089 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e994f0cf-7b43-4b13-9dd5-da6d14f171b3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:51.464063 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e994f0cf-7b43-4b13-9dd5-da6d14f171b3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:51.464685 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e994f0cf-7b43-4b13-9dd5-da6d14f171b3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:51.858918 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell0:SELECT=28 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:52.216015 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-e994f0cf-7b43-4b13-9dd5-da6d14f171b3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:52.231858 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-e994f0cf-7b43-4b13-9dd5-da6d14f171b3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.784216 Jul 12 14:39:52.232366 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 38/74] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:51 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:52.246322 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-53f5f26f-080a-406f-9a00-d77295cdee73 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:52.246937 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-53f5f26f-080a-406f-9a00-d77295cdee73 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:52.253763 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-53f5f26f-080a-406f-9a00-d77295cdee73 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:52.254200 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-53f5f26f-080a-406f-9a00-d77295cdee73 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:52.258045 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-53f5f26f-080a-406f-9a00-d77295cdee73 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:52.258045 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-53f5f26f-080a-406f-9a00-d77295cdee73 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:52.270266 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=100 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:52.321101 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-54316330-f8b9-464f-8936-4b8004bcea96 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:52.333050 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-54316330-f8b9-464f-8936-4b8004bcea96 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:52.334887 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-54316330-f8b9-464f-8936-4b8004bcea96 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:52.336015 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-54316330-f8b9-464f-8936-4b8004bcea96 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 1.139508 Jul 12 14:39:52.344898 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 37/75] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:51 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:39:52.350781 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-b1be4d87-cdd6-424b-9611-a83e3b94cd9f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:52.356072 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-b1be4d87-cdd6-424b-9611-a83e3b94cd9f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:52.364605 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b1be4d87-cdd6-424b-9611-a83e3b94cd9f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:52.364605 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b1be4d87-cdd6-424b-9611-a83e3b94cd9f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:52.364605 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b1be4d87-cdd6-424b-9611-a83e3b94cd9f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:52.365044 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b1be4d87-cdd6-424b-9611-a83e3b94cd9f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:52.399268 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=100 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:52.643904 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-53f5f26f-080a-406f-9a00-d77295cdee73 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:52.682230 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-53f5f26f-080a-406f-9a00-d77295cdee73 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1315 microversion: 2.1 time: 0.448447 Jul 12 14:39:52.686420 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 39/76] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:52 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:52.978682 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-b1be4d87-cdd6-424b-9611-a83e3b94cd9f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:52.994753 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-b1be4d87-cdd6-424b-9611-a83e3b94cd9f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.648387 Jul 12 14:39:52.995782 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 38/77] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:52 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:53.254047 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-668c6fd5-50f7-487e-b46f-92765077a73e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:53.255263 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-668c6fd5-50f7-487e-b46f-92765077a73e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:53.278443 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-668c6fd5-50f7-487e-b46f-92765077a73e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:53.280769 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-668c6fd5-50f7-487e-b46f-92765077a73e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:53.282767 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-668c6fd5-50f7-487e-b46f-92765077a73e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:53.288580 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-668c6fd5-50f7-487e-b46f-92765077a73e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:53.365510 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-7153dad7-9909-4ec7-98d3-1e0f2ad286ef tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:53.366743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-7153dad7-9909-4ec7-98d3-1e0f2ad286ef tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:53.381041 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7153dad7-9909-4ec7-98d3-1e0f2ad286ef tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:53.385746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7153dad7-9909-4ec7-98d3-1e0f2ad286ef tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:53.386763 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7153dad7-9909-4ec7-98d3-1e0f2ad286ef tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:53.387343 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7153dad7-9909-4ec7-98d3-1e0f2ad286ef tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:54.513445 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-668c6fd5-50f7-487e-b46f-92765077a73e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:54.526441 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-668c6fd5-50f7-487e-b46f-92765077a73e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 1.275496 Jul 12 14:39:54.538069 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 40/78] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:53 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:54.543823 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-35ec183b-99aa-4d6d-8a62-c38f0b3e00f5 req-2410156b-1382-4d68-bbee-862119445409 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4be1b083-8bbf-47a2-bcd3-015cd173afa1", "tag": "f286bedd-3258-42e6-b8d5-c69bf1cec4da"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:54.569124 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-35ec183b-99aa-4d6d-8a62-c38f0b3e00f5 req-2410156b-1382-4d68-bbee-862119445409 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:54.573500 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-35ec183b-99aa-4d6d-8a62-c38f0b3e00f5 req-2410156b-1382-4d68-bbee-862119445409 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:54.582507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7153dad7-9909-4ec7-98d3-1e0f2ad286ef tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:54.592353 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7153dad7-9909-4ec7-98d3-1e0f2ad286ef tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:54.599384 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7153dad7-9909-4ec7-98d3-1e0f2ad286ef tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:54.602306 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-7153dad7-9909-4ec7-98d3-1e0f2ad286ef tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 1.242444 Jul 12 14:39:54.608066 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 39/79] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:53 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:39:54.608458 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-35ec183b-99aa-4d6d-8a62-c38f0b3e00f5 req-2410156b-1382-4d68-bbee-862119445409 service nova] Creating event network-changed:f286bedd-3258-42e6-b8d5-c69bf1cec4da for instance 4be1b083-8bbf-47a2-bcd3-015cd173afa1 on hv-cinder-82002 Jul 12 14:39:54.618057 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-4afba96e-c1f4-41a5-8504-99b52822f613 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:54.619167 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-4afba96e-c1f4-41a5-8504-99b52822f613 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:54.621794 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-35ec183b-99aa-4d6d-8a62-c38f0b3e00f5 req-2410156b-1382-4d68-bbee-862119445409 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081292 Jul 12 14:39:54.626076 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 41/80] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:54.632856 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4afba96e-c1f4-41a5-8504-99b52822f613 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:54.636133 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4afba96e-c1f4-41a5-8504-99b52822f613 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:54.638220 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4afba96e-c1f4-41a5-8504-99b52822f613 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:54.639034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4afba96e-c1f4-41a5-8504-99b52822f613 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:54.639750 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-5df7240c-c340-4dfe-8020-a9daac94252a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:54.641762 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-5df7240c-c340-4dfe-8020-a9daac94252a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:54.656626 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5df7240c-c340-4dfe-8020-a9daac94252a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:54.663306 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5df7240c-c340-4dfe-8020-a9daac94252a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:54.664382 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5df7240c-c340-4dfe-8020-a9daac94252a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:54.665046 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5df7240c-c340-4dfe-8020-a9daac94252a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:55.218069 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-5df7240c-c340-4dfe-8020-a9daac94252a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:55.234935 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-5df7240c-c340-4dfe-8020-a9daac94252a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.607252 Jul 12 14:39:55.235580 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 42/81] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:54 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:55.367068 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-4afba96e-c1f4-41a5-8504-99b52822f613 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:55.375308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-4afba96e-c1f4-41a5-8504-99b52822f613 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1315 microversion: 2.1 time: 0.769084 Jul 12 14:39:55.382900 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 40/82] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:54 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1315 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:55.544269 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c2db7025-37ae-4980-bd22-0bcb76689ac3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:55.545562 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-c2db7025-37ae-4980-bd22-0bcb76689ac3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:55.557617 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c2db7025-37ae-4980-bd22-0bcb76689ac3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:55.558066 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c2db7025-37ae-4980-bd22-0bcb76689ac3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:55.566555 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c2db7025-37ae-4980-bd22-0bcb76689ac3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:55.567021 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c2db7025-37ae-4980-bd22-0bcb76689ac3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:55.688224 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-f7a58cb1-b624-4e5b-b897-add2b7003b65 req-0f27eb2a-200a-45f2-809a-e6280ea6798d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e8ad66c-747a-4266-9452-a45bfeefa6c7", "tag": "fc527dbc-5958-4a00-a992-5b997bbfade2"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:55.701581 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-f7a58cb1-b624-4e5b-b897-add2b7003b65 req-0f27eb2a-200a-45f2-809a-e6280ea6798d service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:55.702132 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-f7a58cb1-b624-4e5b-b897-add2b7003b65 req-0f27eb2a-200a-45f2-809a-e6280ea6798d service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:55.720276 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-f7a58cb1-b624-4e5b-b897-add2b7003b65 req-0f27eb2a-200a-45f2-809a-e6280ea6798d service nova] Creating event network-changed:fc527dbc-5958-4a00-a992-5b997bbfade2 for instance 2e8ad66c-747a-4266-9452-a45bfeefa6c7 on hv-cinder-82002 Jul 12 14:39:55.725921 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-f7a58cb1-b624-4e5b-b897-add2b7003b65 req-0f27eb2a-200a-45f2-809a-e6280ea6798d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.479725 Jul 12 14:39:55.726958 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 43/83] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:55.733897 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-d46b0c90-7f0d-4abe-91e1-6e3fc9718613 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:55.735115 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-d46b0c90-7f0d-4abe-91e1-6e3fc9718613 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:55.742067 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d46b0c90-7f0d-4abe-91e1-6e3fc9718613 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:55.742795 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d46b0c90-7f0d-4abe-91e1-6e3fc9718613 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:55.744015 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d46b0c90-7f0d-4abe-91e1-6e3fc9718613 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:55.744628 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d46b0c90-7f0d-4abe-91e1-6e3fc9718613 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:56.328529 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c2db7025-37ae-4980-bd22-0bcb76689ac3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:56.345150 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-c2db7025-37ae-4980-bd22-0bcb76689ac3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.805152 Jul 12 14:39:56.359656 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 41/84] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:55 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:39:56.368362 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-ccd781f3-1757-46a0-b14d-5d6b5961aa30 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:56.371643 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-ccd781f3-1757-46a0-b14d-5d6b5961aa30 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:56.376692 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:56.380784 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ccd781f3-1757-46a0-b14d-5d6b5961aa30 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:56.381471 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ccd781f3-1757-46a0-b14d-5d6b5961aa30 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:56.382599 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ccd781f3-1757-46a0-b14d-5d6b5961aa30 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:56.383192 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ccd781f3-1757-46a0-b14d-5d6b5961aa30 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:56.561084 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-d46b0c90-7f0d-4abe-91e1-6e3fc9718613 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:56.569328 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-d46b0c90-7f0d-4abe-91e1-6e3fc9718613 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:56.577457 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-d46b0c90-7f0d-4abe-91e1-6e3fc9718613 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:56.578863 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-d46b0c90-7f0d-4abe-91e1-6e3fc9718613 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.850031 Jul 12 14:39:56.579586 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 44/85] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:55 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:39:56.591678 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-afff81a9-286c-4f37-a9ca-f473966eb611 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:56.592563 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-afff81a9-286c-4f37-a9ca-f473966eb611 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:56.600519 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-afff81a9-286c-4f37-a9ca-f473966eb611 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:56.601124 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-afff81a9-286c-4f37-a9ca-f473966eb611 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:56.602229 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-afff81a9-286c-4f37-a9ca-f473966eb611 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:56.602826 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-afff81a9-286c-4f37-a9ca-f473966eb611 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:57.034819 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-ccd781f3-1757-46a0-b14d-5d6b5961aa30 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:57.043213 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-ccd781f3-1757-46a0-b14d-5d6b5961aa30 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.682013 Jul 12 14:39:57.049966 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 42/86] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:56 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:57.067629 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-6451dfa9-5276-4554-a9b0-efed9c391c3a req-7822d2c4-0db9-43ea-80fd-05e9040104e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8f59b92-aa7f-496d-a19c-9035a4948560", "tag": "68fcc4b4-c1bb-4548-816a-03ac719e76aa"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:57.087640 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-6451dfa9-5276-4554-a9b0-efed9c391c3a req-7822d2c4-0db9-43ea-80fd-05e9040104e8 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:57.094503 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-6451dfa9-5276-4554-a9b0-efed9c391c3a req-7822d2c4-0db9-43ea-80fd-05e9040104e8 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:57.133413 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-6451dfa9-5276-4554-a9b0-efed9c391c3a req-7822d2c4-0db9-43ea-80fd-05e9040104e8 service nova] Creating event network-changed:68fcc4b4-c1bb-4548-816a-03ac719e76aa for instance b8f59b92-aa7f-496d-a19c-9035a4948560 on hv-cinder-82002 Jul 12 14:39:57.134638 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-6451dfa9-5276-4554-a9b0-efed9c391c3a req-7822d2c4-0db9-43ea-80fd-05e9040104e8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129981) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 12 14:39:57.144925 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-afff81a9-286c-4f37-a9ca-f473966eb611 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:57.162567 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-46ee4cb7-8da0-4967-8a54-68e9d852e49e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:57.163568 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-46ee4cb7-8da0-4967-8a54-68e9d852e49e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:57.166355 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-46ee4cb7-8da0-4967-8a54-68e9d852e49e None None] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:57.166631 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-afff81a9-286c-4f37-a9ca-f473966eb611 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1315 microversion: 2.1 time: 0.583397 Jul 12 14:39:57.168911 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-46ee4cb7-8da0-4967-8a54-68e9d852e49e None None] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:57.172015 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 45/87] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:56 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1315 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:57.184858 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.compute.rpcapi [None req-46ee4cb7-8da0-4967-8a54-68e9d852e49e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 12 14:39:57.184858 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-46ee4cb7-8da0-4967-8a54-68e9d852e49e None None] Releasing lock "compute-rpcapi-router" {{(pid=129981) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 12 14:39:57.212986 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-46ee4cb7-8da0-4967-8a54-68e9d852e49e None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161485 Jul 12 14:39:57.213777 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 43/88] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:57.374109 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-849f4114-4f89-4151-9cc0-05eef60f8c5e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:57.374109 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-849f4114-4f89-4151-9cc0-05eef60f8c5e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:57.376316 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-849f4114-4f89-4151-9cc0-05eef60f8c5e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:57.381304 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-849f4114-4f89-4151-9cc0-05eef60f8c5e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:57.382559 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-849f4114-4f89-4151-9cc0-05eef60f8c5e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:57.382997 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-849f4114-4f89-4151-9cc0-05eef60f8c5e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:57.601922 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-9a94784e-0645-4ba6-8758-03a6c9e7b784 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:57.602588 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-9a94784e-0645-4ba6-8758-03a6c9e7b784 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:57.610829 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9a94784e-0645-4ba6-8758-03a6c9e7b784 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:57.614062 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9a94784e-0645-4ba6-8758-03a6c9e7b784 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:57.614062 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9a94784e-0645-4ba6-8758-03a6c9e7b784 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:57.614062 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9a94784e-0645-4ba6-8758-03a6c9e7b784 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:58.222731 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-849f4114-4f89-4151-9cc0-05eef60f8c5e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:58.230771 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-849f4114-4f89-4151-9cc0-05eef60f8c5e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.867405 Jul 12 14:39:58.242159 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 46/89] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:57 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:58.247269 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-ea3e5bf1-b842-46ce-8fd2-c392006ae41f req-4a64bb2d-cb03-4705-b0ad-9203167ac52f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26eeea2d-c1c2-46a7-b727-269cf6dce92a", "tag": "f0edff70-5e51-412d-b474-2a70b09725f5"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:58.256009 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-ea3e5bf1-b842-46ce-8fd2-c392006ae41f req-4a64bb2d-cb03-4705-b0ad-9203167ac52f service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:58.256757 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-ea3e5bf1-b842-46ce-8fd2-c392006ae41f req-4a64bb2d-cb03-4705-b0ad-9203167ac52f service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:58.268956 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-ea3e5bf1-b842-46ce-8fd2-c392006ae41f req-4a64bb2d-cb03-4705-b0ad-9203167ac52f service nova] Creating event network-changed:f0edff70-5e51-412d-b474-2a70b09725f5 for instance 26eeea2d-c1c2-46a7-b727-269cf6dce92a on hv-cinder-82002 Jul 12 14:39:58.277305 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-ea3e5bf1-b842-46ce-8fd2-c392006ae41f req-4a64bb2d-cb03-4705-b0ad-9203167ac52f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033476 Jul 12 14:39:58.280214 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 47/90] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:58.293133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-20c509a6-4968-4a0d-ab59-45a5d99f7726 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:58.294202 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-20c509a6-4968-4a0d-ab59-45a5d99f7726 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:58.315142 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-20c509a6-4968-4a0d-ab59-45a5d99f7726 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:58.315608 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-20c509a6-4968-4a0d-ab59-45a5d99f7726 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:58.316396 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-20c509a6-4968-4a0d-ab59-45a5d99f7726 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:58.316992 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-20c509a6-4968-4a0d-ab59-45a5d99f7726 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:58.563162 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-9a94784e-0645-4ba6-8758-03a6c9e7b784 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:58.593568 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-9a94784e-0645-4ba6-8758-03a6c9e7b784 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:58.595649 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-9a94784e-0645-4ba6-8758-03a6c9e7b784 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:58.597349 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-9a94784e-0645-4ba6-8758-03a6c9e7b784 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 1.002253 Jul 12 14:39:58.610967 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 44/91] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:57 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:39:58.617450 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-3ebfb14f-f949-41a1-bdd4-6c824c753a9c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:58.626414 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-3ebfb14f-f949-41a1-bdd4-6c824c753a9c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:58.634816 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3ebfb14f-f949-41a1-bdd4-6c824c753a9c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:58.635544 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3ebfb14f-f949-41a1-bdd4-6c824c753a9c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:58.636572 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3ebfb14f-f949-41a1-bdd4-6c824c753a9c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:58.637150 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3ebfb14f-f949-41a1-bdd4-6c824c753a9c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:58.985702 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-20c509a6-4968-4a0d-ab59-45a5d99f7726 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:58.994156 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-20c509a6-4968-4a0d-ab59-45a5d99f7726 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.712538 Jul 12 14:39:58.996830 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 48/92] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:58 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:59.023773 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-3ebfb14f-f949-41a1-bdd4-6c824c753a9c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:59.032008 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-3ebfb14f-f949-41a1-bdd4-6c824c753a9c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1315 microversion: 2.1 time: 0.419243 Jul 12 14:39:59.032583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 45/93] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:58 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:59.250142 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-a7028a9d-1973-47ce-b2b3-5e0d92b6482c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:59.250754 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-a7028a9d-1973-47ce-b2b3-5e0d92b6482c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:59.256631 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a7028a9d-1973-47ce-b2b3-5e0d92b6482c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:59.257082 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a7028a9d-1973-47ce-b2b3-5e0d92b6482c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:59.257874 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a7028a9d-1973-47ce-b2b3-5e0d92b6482c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:59.258311 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a7028a9d-1973-47ce-b2b3-5e0d92b6482c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:59.395462 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-a7028a9d-1973-47ce-b2b3-5e0d92b6482c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:59.409839 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-a7028a9d-1973-47ce-b2b3-5e0d92b6482c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.163831 Jul 12 14:39:59.419232 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 49/94] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:59 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:59.617616 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-558a48b0-fe42-4dde-b1e5-c8bacfb6952f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:59.618215 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-558a48b0-fe42-4dde-b1e5-c8bacfb6952f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:59.625216 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-558a48b0-fe42-4dde-b1e5-c8bacfb6952f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:59.627021 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-558a48b0-fe42-4dde-b1e5-c8bacfb6952f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:59.627021 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-558a48b0-fe42-4dde-b1e5-c8bacfb6952f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:59.627021 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-558a48b0-fe42-4dde-b1e5-c8bacfb6952f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:59.763693 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-558a48b0-fe42-4dde-b1e5-c8bacfb6952f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:59.771614 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-558a48b0-fe42-4dde-b1e5-c8bacfb6952f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:59.773054 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-558a48b0-fe42-4dde-b1e5-c8bacfb6952f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:59.774181 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-558a48b0-fe42-4dde-b1e5-c8bacfb6952f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.160702 Jul 12 14:39:59.774737 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 46/95] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:59 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:40:00.013849 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-a39f8cda-a392-407c-9d5e-e268832d51fa tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:00.014459 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-a39f8cda-a392-407c-9d5e-e268832d51fa tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:00.020812 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a39f8cda-a392-407c-9d5e-e268832d51fa tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:00.021496 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a39f8cda-a392-407c-9d5e-e268832d51fa tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:00.022716 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a39f8cda-a392-407c-9d5e-e268832d51fa tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:00.023629 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a39f8cda-a392-407c-9d5e-e268832d51fa tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:00.050326 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-dbe07084-aeb9-4029-ab8a-a5b36d2a26e1 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:00.051177 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-dbe07084-aeb9-4029-ab8a-a5b36d2a26e1 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:00.057512 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-dbe07084-aeb9-4029-ab8a-a5b36d2a26e1 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:00.064133 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-dbe07084-aeb9-4029-ab8a-a5b36d2a26e1 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:00.064133 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-dbe07084-aeb9-4029-ab8a-a5b36d2a26e1 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:00.064133 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-dbe07084-aeb9-4029-ab8a-a5b36d2a26e1 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:00.230073 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-a39f8cda-a392-407c-9d5e-e268832d51fa tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:00.239136 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-a39f8cda-a392-407c-9d5e-e268832d51fa tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.229320 Jul 12 14:40:00.249315 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 50/96] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:00 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:00.249675 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-dbe07084-aeb9-4029-ab8a-a5b36d2a26e1 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:00.252862 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-dbe07084-aeb9-4029-ab8a-a5b36d2a26e1 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1315 microversion: 2.1 time: 0.206677 Jul 12 14:40:00.253561 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 47/97] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:00 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:00.429371 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-af0e0a44-de60-4578-bf2a-a31b1a82e45b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:00.429371 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-af0e0a44-de60-4578-bf2a-a31b1a82e45b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:00.434180 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-af0e0a44-de60-4578-bf2a-a31b1a82e45b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:00.434633 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-af0e0a44-de60-4578-bf2a-a31b1a82e45b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:00.436532 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-af0e0a44-de60-4578-bf2a-a31b1a82e45b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:00.436969 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-af0e0a44-de60-4578-bf2a-a31b1a82e45b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:00.569522 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-af0e0a44-de60-4578-bf2a-a31b1a82e45b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:00.578706 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-af0e0a44-de60-4578-bf2a-a31b1a82e45b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.155179 Jul 12 14:40:00.579666 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 51/98] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:00 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:00.791919 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-a7ef6cfe-d67a-4e00-ba80-a1c90f6a3bec tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:00.792520 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-a7ef6cfe-d67a-4e00-ba80-a1c90f6a3bec tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:00.798504 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a7ef6cfe-d67a-4e00-ba80-a1c90f6a3bec tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:00.798942 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a7ef6cfe-d67a-4e00-ba80-a1c90f6a3bec tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:00.799714 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a7ef6cfe-d67a-4e00-ba80-a1c90f6a3bec tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:00.800138 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a7ef6cfe-d67a-4e00-ba80-a1c90f6a3bec tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:00.939313 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-a7ef6cfe-d67a-4e00-ba80-a1c90f6a3bec tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:00.947780 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-a7ef6cfe-d67a-4e00-ba80-a1c90f6a3bec tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:00.949491 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-a7ef6cfe-d67a-4e00-ba80-a1c90f6a3bec tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:00.951174 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-a7ef6cfe-d67a-4e00-ba80-a1c90f6a3bec tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.162803 Jul 12 14:40:00.951739 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 48/99] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:00 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:40:01.258036 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-19550b89-f06b-4936-aa30-086654892482 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:01.260988 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-19550b89-f06b-4936-aa30-086654892482 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:01.265462 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-19550b89-f06b-4936-aa30-086654892482 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:01.265918 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-19550b89-f06b-4936-aa30-086654892482 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:01.266683 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-19550b89-f06b-4936-aa30-086654892482 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:01.267277 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-19550b89-f06b-4936-aa30-086654892482 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:01.271145 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e50d5b0a-3583-4823-90a4-106a2829634a tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:01.272003 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-e50d5b0a-3583-4823-90a4-106a2829634a tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:01.280826 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e50d5b0a-3583-4823-90a4-106a2829634a tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:01.281382 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e50d5b0a-3583-4823-90a4-106a2829634a tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:01.282219 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e50d5b0a-3583-4823-90a4-106a2829634a tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:01.282719 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e50d5b0a-3583-4823-90a4-106a2829634a tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:01.422657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell0:SELECT=2 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:01.494060 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-19550b89-f06b-4936-aa30-086654892482 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:01.500737 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e50d5b0a-3583-4823-90a4-106a2829634a tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:01.502431 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-19550b89-f06b-4936-aa30-086654892482 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.248166 Jul 12 14:40:01.503773 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 52/100] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:01 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:01.518305 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-e50d5b0a-3583-4823-90a4-106a2829634a tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1315 microversion: 2.1 time: 0.251933 Jul 12 14:40:01.518886 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 49/101] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:01 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:01.611296 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-792b1f0e-c80c-4888-8c71-b041b14a3719 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:01.612205 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-792b1f0e-c80c-4888-8c71-b041b14a3719 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:01.628598 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-792b1f0e-c80c-4888-8c71-b041b14a3719 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:01.629251 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-792b1f0e-c80c-4888-8c71-b041b14a3719 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:01.630178 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-792b1f0e-c80c-4888-8c71-b041b14a3719 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:01.630702 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-792b1f0e-c80c-4888-8c71-b041b14a3719 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:01.916089 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-792b1f0e-c80c-4888-8c71-b041b14a3719 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:01.924127 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-792b1f0e-c80c-4888-8c71-b041b14a3719 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.321618 Jul 12 14:40:01.924715 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 53/102] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:01 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:01.969926 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-723ca8ff-7930-4954-8418-f54b0b25f170 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:01.970628 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-723ca8ff-7930-4954-8418-f54b0b25f170 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:01.976790 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-723ca8ff-7930-4954-8418-f54b0b25f170 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:01.977282 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-723ca8ff-7930-4954-8418-f54b0b25f170 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:01.978041 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-723ca8ff-7930-4954-8418-f54b0b25f170 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:01.978472 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-723ca8ff-7930-4954-8418-f54b0b25f170 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:02.136702 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-723ca8ff-7930-4954-8418-f54b0b25f170 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:02.146266 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-723ca8ff-7930-4954-8418-f54b0b25f170 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:02.147746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-723ca8ff-7930-4954-8418-f54b0b25f170 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:02.148853 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-723ca8ff-7930-4954-8418-f54b0b25f170 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.183463 Jul 12 14:40:02.149442 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 50/103] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:01 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:40:02.519974 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-fca01597-1aa8-40bd-a6ea-ef59b4e17010 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:02.520727 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-fca01597-1aa8-40bd-a6ea-ef59b4e17010 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:02.527259 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fca01597-1aa8-40bd-a6ea-ef59b4e17010 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:02.530001 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fca01597-1aa8-40bd-a6ea-ef59b4e17010 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:02.530001 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fca01597-1aa8-40bd-a6ea-ef59b4e17010 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:02.530001 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fca01597-1aa8-40bd-a6ea-ef59b4e17010 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:02.535815 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-615efc79-7e9d-4ce5-a7ee-99ab9338fd5e tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:02.536477 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-615efc79-7e9d-4ce5-a7ee-99ab9338fd5e tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:02.542590 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-615efc79-7e9d-4ce5-a7ee-99ab9338fd5e tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:02.543029 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-615efc79-7e9d-4ce5-a7ee-99ab9338fd5e tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:02.543789 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-615efc79-7e9d-4ce5-a7ee-99ab9338fd5e tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:02.544732 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-615efc79-7e9d-4ce5-a7ee-99ab9338fd5e tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:02.735826 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-fca01597-1aa8-40bd-a6ea-ef59b4e17010 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:02.739078 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-615efc79-7e9d-4ce5-a7ee-99ab9338fd5e tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:02.744114 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-fca01597-1aa8-40bd-a6ea-ef59b4e17010 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.227919 Jul 12 14:40:02.744686 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 54/104] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:02 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:02.754343 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-615efc79-7e9d-4ce5-a7ee-99ab9338fd5e tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1315 microversion: 2.1 time: 0.214958 Jul 12 14:40:02.757024 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 51/105] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:02 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:02.940745 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-3f55db64-bb26-45f1-b0e1-e8e8e597bc6b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:02.941401 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-3f55db64-bb26-45f1-b0e1-e8e8e597bc6b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:02.947771 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3f55db64-bb26-45f1-b0e1-e8e8e597bc6b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:02.948219 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3f55db64-bb26-45f1-b0e1-e8e8e597bc6b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:02.948981 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3f55db64-bb26-45f1-b0e1-e8e8e597bc6b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:02.949443 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3f55db64-bb26-45f1-b0e1-e8e8e597bc6b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:03.076347 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-3f55db64-bb26-45f1-b0e1-e8e8e597bc6b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:03.083848 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-3f55db64-bb26-45f1-b0e1-e8e8e597bc6b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.146984 Jul 12 14:40:03.084411 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 55/106] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:02 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:03.167589 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e7cc066f-6b1e-4171-8afa-51675a02af03 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:03.168200 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-e7cc066f-6b1e-4171-8afa-51675a02af03 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:03.174915 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e7cc066f-6b1e-4171-8afa-51675a02af03 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:03.175365 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e7cc066f-6b1e-4171-8afa-51675a02af03 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:03.176119 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e7cc066f-6b1e-4171-8afa-51675a02af03 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:03.176554 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e7cc066f-6b1e-4171-8afa-51675a02af03 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:03.314447 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e7cc066f-6b1e-4171-8afa-51675a02af03 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:03.322562 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e7cc066f-6b1e-4171-8afa-51675a02af03 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:03.324097 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e7cc066f-6b1e-4171-8afa-51675a02af03 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:03.325195 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-e7cc066f-6b1e-4171-8afa-51675a02af03 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.161528 Jul 12 14:40:03.326298 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 52/107] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:03 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:40:03.761600 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-c286faf4-bba8-4e23-9ba6-e18463e3d446 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:03.762757 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-c286faf4-bba8-4e23-9ba6-e18463e3d446 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:03.764060 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-530c9400-522e-4e80-9d70-a75dba070e0c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:03.764899 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-530c9400-522e-4e80-9d70-a75dba070e0c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:03.769682 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c286faf4-bba8-4e23-9ba6-e18463e3d446 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:03.770168 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c286faf4-bba8-4e23-9ba6-e18463e3d446 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:03.770929 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c286faf4-bba8-4e23-9ba6-e18463e3d446 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:03.771360 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c286faf4-bba8-4e23-9ba6-e18463e3d446 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:03.771464 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-530c9400-522e-4e80-9d70-a75dba070e0c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:03.771824 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-530c9400-522e-4e80-9d70-a75dba070e0c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:03.772574 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-530c9400-522e-4e80-9d70-a75dba070e0c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:03.773001 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-530c9400-522e-4e80-9d70-a75dba070e0c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:03.961075 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-c286faf4-bba8-4e23-9ba6-e18463e3d446 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:03.973017 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-c286faf4-bba8-4e23-9ba6-e18463e3d446 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.214256 Jul 12 14:40:03.973744 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 56/108] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:03 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:03.979735 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-530c9400-522e-4e80-9d70-a75dba070e0c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:03.991136 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-530c9400-522e-4e80-9d70-a75dba070e0c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1315 microversion: 2.1 time: 0.231329 Jul 12 14:40:03.991759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 53/109] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:03 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:04.101055 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-89cc486b-a831-439b-a195-91cd88c77edd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:04.101691 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-89cc486b-a831-439b-a195-91cd88c77edd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:04.108222 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-89cc486b-a831-439b-a195-91cd88c77edd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:04.108670 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-89cc486b-a831-439b-a195-91cd88c77edd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:04.109448 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-89cc486b-a831-439b-a195-91cd88c77edd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:04.109876 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-89cc486b-a831-439b-a195-91cd88c77edd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:04.240833 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-89cc486b-a831-439b-a195-91cd88c77edd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:04.244281 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=100 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:04.251073 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-89cc486b-a831-439b-a195-91cd88c77edd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.153875 Jul 12 14:40:04.251668 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 57/110] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:04 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:04.344366 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-17f2afdf-09aa-4ff7-bdac-ac0719db9a00 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:04.344995 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-17f2afdf-09aa-4ff7-bdac-ac0719db9a00 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:04.351142 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-17f2afdf-09aa-4ff7-bdac-ac0719db9a00 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:04.351613 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-17f2afdf-09aa-4ff7-bdac-ac0719db9a00 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:04.352371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-17f2afdf-09aa-4ff7-bdac-ac0719db9a00 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:04.352812 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-17f2afdf-09aa-4ff7-bdac-ac0719db9a00 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:04.527454 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-17f2afdf-09aa-4ff7-bdac-ac0719db9a00 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:04.527454 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-17f2afdf-09aa-4ff7-bdac-ac0719db9a00 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:04.527675 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-17f2afdf-09aa-4ff7-bdac-ac0719db9a00 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:04.527675 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-17f2afdf-09aa-4ff7-bdac-ac0719db9a00 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.170165 Jul 12 14:40:04.527675 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 54/111] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:04 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:40:04.990846 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-9fa234e5-6d20-40b8-bbc1-df46c2272525 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:04.991467 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-9fa234e5-6d20-40b8-bbc1-df46c2272525 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:04.998609 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9fa234e5-6d20-40b8-bbc1-df46c2272525 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:04.999054 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9fa234e5-6d20-40b8-bbc1-df46c2272525 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:04.999846 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9fa234e5-6d20-40b8-bbc1-df46c2272525 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:05.000277 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9fa234e5-6d20-40b8-bbc1-df46c2272525 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:05.009191 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-047bead4-1aab-4fb3-aad7-5a70489d86f4 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:05.009810 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-047bead4-1aab-4fb3-aad7-5a70489d86f4 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:05.018663 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-047bead4-1aab-4fb3-aad7-5a70489d86f4 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:05.018663 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-047bead4-1aab-4fb3-aad7-5a70489d86f4 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:05.018663 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-047bead4-1aab-4fb3-aad7-5a70489d86f4 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:05.018663 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-047bead4-1aab-4fb3-aad7-5a70489d86f4 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:05.036092 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=100 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:05.197877 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-9fa234e5-6d20-40b8-bbc1-df46c2272525 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:05.200919 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-047bead4-1aab-4fb3-aad7-5a70489d86f4 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:05.205760 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-9fa234e5-6d20-40b8-bbc1-df46c2272525 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.218895 Jul 12 14:40:05.206421 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 58/112] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:04 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:05.208436 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-047bead4-1aab-4fb3-aad7-5a70489d86f4 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1315 microversion: 2.1 time: 0.203300 Jul 12 14:40:05.208991 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 55/113] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:05 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:05.267462 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-127ed634-3ae9-4739-881f-487bdb50c891 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:05.268077 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-127ed634-3ae9-4739-881f-487bdb50c891 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:05.274436 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-127ed634-3ae9-4739-881f-487bdb50c891 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:05.275007 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-127ed634-3ae9-4739-881f-487bdb50c891 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:05.275758 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-127ed634-3ae9-4739-881f-487bdb50c891 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:05.276193 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-127ed634-3ae9-4739-881f-487bdb50c891 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:05.414260 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-127ed634-3ae9-4739-881f-487bdb50c891 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:05.422415 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-127ed634-3ae9-4739-881f-487bdb50c891 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.158785 Jul 12 14:40:05.422988 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 59/114] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:05 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:05.544414 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-ea2b62a0-4d6f-4886-8b30-6e4634d6fce5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:05.544997 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-ea2b62a0-4d6f-4886-8b30-6e4634d6fce5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:05.551826 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ea2b62a0-4d6f-4886-8b30-6e4634d6fce5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:05.552349 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ea2b62a0-4d6f-4886-8b30-6e4634d6fce5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:05.553392 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ea2b62a0-4d6f-4886-8b30-6e4634d6fce5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:05.553921 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ea2b62a0-4d6f-4886-8b30-6e4634d6fce5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:05.698320 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-ea2b62a0-4d6f-4886-8b30-6e4634d6fce5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:05.706795 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-ea2b62a0-4d6f-4886-8b30-6e4634d6fce5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:05.708245 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-ea2b62a0-4d6f-4886-8b30-6e4634d6fce5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:05.709374 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-ea2b62a0-4d6f-4886-8b30-6e4634d6fce5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.169881 Jul 12 14:40:05.709936 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 56/115] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:05 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:40:06.222065 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-3912ead6-79a7-4c97-ac75-b8df47ca66cb tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:06.222688 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-3912ead6-79a7-4c97-ac75-b8df47ca66cb tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:06.228701 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3912ead6-79a7-4c97-ac75-b8df47ca66cb tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:06.229183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3912ead6-79a7-4c97-ac75-b8df47ca66cb tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:06.229951 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3912ead6-79a7-4c97-ac75-b8df47ca66cb tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:06.230389 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3912ead6-79a7-4c97-ac75-b8df47ca66cb tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:06.238504 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-b004c66e-9622-4063-bc14-6f7f80238795 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:06.239189 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-b004c66e-9622-4063-bc14-6f7f80238795 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:06.245410 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b004c66e-9622-4063-bc14-6f7f80238795 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:06.245919 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b004c66e-9622-4063-bc14-6f7f80238795 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:06.246672 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b004c66e-9622-4063-bc14-6f7f80238795 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:06.247686 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b004c66e-9622-4063-bc14-6f7f80238795 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:06.465335 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-3912ead6-79a7-4c97-ac75-b8df47ca66cb tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:06.474786 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-3912ead6-79a7-4c97-ac75-b8df47ca66cb tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.256568 Jul 12 14:40:06.475542 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 60/116] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:06 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:06.482414 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-e86658db-cac5-4554-b77f-c89542566319 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:06.483275 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-e86658db-cac5-4554-b77f-c89542566319 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:06.489077 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-b004c66e-9622-4063-bc14-6f7f80238795 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:06.491126 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e86658db-cac5-4554-b77f-c89542566319 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:06.491601 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e86658db-cac5-4554-b77f-c89542566319 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:06.492388 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e86658db-cac5-4554-b77f-c89542566319 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:06.493228 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e86658db-cac5-4554-b77f-c89542566319 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:06.496586 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-b004c66e-9622-4063-bc14-6f7f80238795 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1315 microversion: 2.1 time: 0.262176 Jul 12 14:40:06.498414 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 57/117] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:06 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:06.629358 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-e86658db-cac5-4554-b77f-c89542566319 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:06.637906 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-e86658db-cac5-4554-b77f-c89542566319 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.161128 Jul 12 14:40:06.648311 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 61/118] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:06 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:06.727496 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-324420f7-d0e5-4c97-8028-769c67115305 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:06.728072 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-324420f7-d0e5-4c97-8028-769c67115305 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:06.734786 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-324420f7-d0e5-4c97-8028-769c67115305 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:06.735236 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-324420f7-d0e5-4c97-8028-769c67115305 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:06.735992 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-324420f7-d0e5-4c97-8028-769c67115305 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:06.736429 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-324420f7-d0e5-4c97-8028-769c67115305 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:06.865106 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-324420f7-d0e5-4c97-8028-769c67115305 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:06.873687 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-324420f7-d0e5-4c97-8028-769c67115305 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:06.875599 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-324420f7-d0e5-4c97-8028-769c67115305 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:06.876663 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-324420f7-d0e5-4c97-8028-769c67115305 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.153097 Jul 12 14:40:06.881316 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 58/119] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:06 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:40:07.491660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-dd2d092d-0f0f-4cd5-b6d6-51ea3158494a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:07.492275 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-dd2d092d-0f0f-4cd5-b6d6-51ea3158494a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:07.498969 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-dd2d092d-0f0f-4cd5-b6d6-51ea3158494a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:07.499426 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-dd2d092d-0f0f-4cd5-b6d6-51ea3158494a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:07.500196 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-dd2d092d-0f0f-4cd5-b6d6-51ea3158494a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:07.500635 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-dd2d092d-0f0f-4cd5-b6d6-51ea3158494a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:07.516037 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-bc134e11-da83-406d-8b52-52a9d490596f tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:07.516929 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-bc134e11-da83-406d-8b52-52a9d490596f tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:07.520314 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell0:SELECT=2 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:07.524209 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bc134e11-da83-406d-8b52-52a9d490596f tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:07.525078 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bc134e11-da83-406d-8b52-52a9d490596f tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:07.525893 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bc134e11-da83-406d-8b52-52a9d490596f tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:07.526324 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bc134e11-da83-406d-8b52-52a9d490596f tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:07.908848 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-dd2d092d-0f0f-4cd5-b6d6-51ea3158494a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:07.916169 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-bc134e11-da83-406d-8b52-52a9d490596f tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:07.928551 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-dd2d092d-0f0f-4cd5-b6d6-51ea3158494a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.428638 Jul 12 14:40:07.928551 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 62/120] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:07 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:07.928551 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-6ecde1d5-049f-4e18-8be3-7c11d2673058 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:07.928551 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-6ecde1d5-049f-4e18-8be3-7c11d2673058 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:07.929028 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-bc134e11-da83-406d-8b52-52a9d490596f tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1315 microversion: 2.1 time: 0.415096 Jul 12 14:40:07.929028 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 59/121] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:07 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:07.932930 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-6936653b-17b6-452b-bfd9-b0db1185f769 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:07.933566 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-6936653b-17b6-452b-bfd9-b0db1185f769 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:07.940605 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6936653b-17b6-452b-bfd9-b0db1185f769 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:07.941060 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6936653b-17b6-452b-bfd9-b0db1185f769 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:07.941244 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6ecde1d5-049f-4e18-8be3-7c11d2673058 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:07.941697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6ecde1d5-049f-4e18-8be3-7c11d2673058 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:07.941873 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6936653b-17b6-452b-bfd9-b0db1185f769 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:07.942313 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6936653b-17b6-452b-bfd9-b0db1185f769 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:07.942503 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6ecde1d5-049f-4e18-8be3-7c11d2673058 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:07.942945 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6ecde1d5-049f-4e18-8be3-7c11d2673058 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:08.170031 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-6936653b-17b6-452b-bfd9-b0db1185f769 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:08.178048 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-6936653b-17b6-452b-bfd9-b0db1185f769 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:08.179537 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-6936653b-17b6-452b-bfd9-b0db1185f769 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:08.180644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-6936653b-17b6-452b-bfd9-b0db1185f769 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.251582 Jul 12 14:40:08.181222 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 60/122] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:07 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:40:08.190308 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-6ecde1d5-049f-4e18-8be3-7c11d2673058 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:08.197959 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-6ecde1d5-049f-4e18-8be3-7c11d2673058 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.279818 Jul 12 14:40:08.198773 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 63/123] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:07 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:08.935158 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d6afd957-f810-4abf-8e7a-8358375db9e1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:08.935770 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-d6afd957-f810-4abf-8e7a-8358375db9e1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:08.942629 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d6afd957-f810-4abf-8e7a-8358375db9e1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:08.943084 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d6afd957-f810-4abf-8e7a-8358375db9e1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:08.943931 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d6afd957-f810-4abf-8e7a-8358375db9e1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:08.944373 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d6afd957-f810-4abf-8e7a-8358375db9e1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:08.951546 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ebc39ceb-9420-43d4-ae76-fd7b5ac4d827 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:08.952186 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-ebc39ceb-9420-43d4-ae76-fd7b5ac4d827 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:08.961452 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ebc39ceb-9420-43d4-ae76-fd7b5ac4d827 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:08.962209 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ebc39ceb-9420-43d4-ae76-fd7b5ac4d827 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:08.963222 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ebc39ceb-9420-43d4-ae76-fd7b5ac4d827 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:08.963821 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ebc39ceb-9420-43d4-ae76-fd7b5ac4d827 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:09.133063 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d6afd957-f810-4abf-8e7a-8358375db9e1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:09.142872 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-d6afd957-f810-4abf-8e7a-8358375db9e1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.211992 Jul 12 14:40:09.143448 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 61/124] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:08 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:09.185033 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ebc39ceb-9420-43d4-ae76-fd7b5ac4d827 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:09.198621 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-a0150b0d-8771-40ac-a8d4-d37c4f40de5f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:09.199307 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-a0150b0d-8771-40ac-a8d4-d37c4f40de5f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:09.207416 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a0150b0d-8771-40ac-a8d4-d37c4f40de5f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:09.209194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ebc39ceb-9420-43d4-ae76-fd7b5ac4d827 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1315 microversion: 2.1 time: 0.267168 Jul 12 14:40:09.209709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 64/125] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:08 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:09.210676 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a0150b0d-8771-40ac-a8d4-d37c4f40de5f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:09.211759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a0150b0d-8771-40ac-a8d4-d37c4f40de5f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:09.217862 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a0150b0d-8771-40ac-a8d4-d37c4f40de5f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:09.218070 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-999677b0-7e44-4dd6-a2a2-ad7e337aaff7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:09.218070 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-999677b0-7e44-4dd6-a2a2-ad7e337aaff7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:09.223015 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-999677b0-7e44-4dd6-a2a2-ad7e337aaff7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:09.223650 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-999677b0-7e44-4dd6-a2a2-ad7e337aaff7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:09.224561 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-999677b0-7e44-4dd6-a2a2-ad7e337aaff7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:09.225176 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-999677b0-7e44-4dd6-a2a2-ad7e337aaff7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:09.411848 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-a0150b0d-8771-40ac-a8d4-d37c4f40de5f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:09.420748 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-a0150b0d-8771-40ac-a8d4-d37c4f40de5f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:09.422566 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-a0150b0d-8771-40ac-a8d4-d37c4f40de5f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:09.424010 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-a0150b0d-8771-40ac-a8d4-d37c4f40de5f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.229431 Jul 12 14:40:09.424565 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 62/126] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:09 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:40:09.430310 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-999677b0-7e44-4dd6-a2a2-ad7e337aaff7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:09.440291 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-999677b0-7e44-4dd6-a2a2-ad7e337aaff7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.227605 Jul 12 14:40:09.441314 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 65/127] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:09 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:10.160142 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-4be77ddf-d53e-411d-b977-531b52f51e98 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:10.160755 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-4be77ddf-d53e-411d-b977-531b52f51e98 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:10.167274 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4be77ddf-d53e-411d-b977-531b52f51e98 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:10.167722 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4be77ddf-d53e-411d-b977-531b52f51e98 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:10.168482 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4be77ddf-d53e-411d-b977-531b52f51e98 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:10.168942 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4be77ddf-d53e-411d-b977-531b52f51e98 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:10.233303 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-eec384f7-8af9-4677-9d0a-0b9391a32f2b tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:10.234107 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-eec384f7-8af9-4677-9d0a-0b9391a32f2b tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:10.240537 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-eec384f7-8af9-4677-9d0a-0b9391a32f2b tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:10.240998 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-eec384f7-8af9-4677-9d0a-0b9391a32f2b tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:10.241901 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-eec384f7-8af9-4677-9d0a-0b9391a32f2b tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:10.242372 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-eec384f7-8af9-4677-9d0a-0b9391a32f2b tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:10.359012 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-4be77ddf-d53e-411d-b977-531b52f51e98 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:10.367923 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-4be77ddf-d53e-411d-b977-531b52f51e98 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.211598 Jul 12 14:40:10.368499 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 63/128] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:10 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:10.409964 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-eec384f7-8af9-4677-9d0a-0b9391a32f2b tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:10.417988 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-eec384f7-8af9-4677-9d0a-0b9391a32f2b tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1315 microversion: 2.1 time: 0.189569 Jul 12 14:40:10.418591 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 66/129] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:10 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:10.444957 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-97d44fef-4331-4e2e-8083-1ca1b2a74640 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:10.446056 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-97d44fef-4331-4e2e-8083-1ca1b2a74640 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:10.454591 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-97d44fef-4331-4e2e-8083-1ca1b2a74640 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:10.455141 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-97d44fef-4331-4e2e-8083-1ca1b2a74640 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:10.456401 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-97d44fef-4331-4e2e-8083-1ca1b2a74640 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:10.456913 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-97d44fef-4331-4e2e-8083-1ca1b2a74640 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:10.460565 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-6ad0f8de-2e61-4446-92c9-e3844b6951bc tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:10.461486 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-6ad0f8de-2e61-4446-92c9-e3844b6951bc tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:10.468221 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6ad0f8de-2e61-4446-92c9-e3844b6951bc tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:10.469328 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6ad0f8de-2e61-4446-92c9-e3844b6951bc tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:10.471746 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6ad0f8de-2e61-4446-92c9-e3844b6951bc tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:10.472200 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6ad0f8de-2e61-4446-92c9-e3844b6951bc tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:10.667898 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-97d44fef-4331-4e2e-8083-1ca1b2a74640 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:10.679499 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-6ad0f8de-2e61-4446-92c9-e3844b6951bc tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:10.686824 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-97d44fef-4331-4e2e-8083-1ca1b2a74640 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:10.686824 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-97d44fef-4331-4e2e-8083-1ca1b2a74640 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:10.687792 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-97d44fef-4331-4e2e-8083-1ca1b2a74640 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.249399 Jul 12 14:40:10.689041 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 64/130] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:10 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:40:10.691729 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-6ad0f8de-2e61-4446-92c9-e3844b6951bc tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.236341 Jul 12 14:40:10.692320 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 67/131] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:10 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:11.387563 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-6c48a324-ff18-43c7-a5f2-e578ffef9c7c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:11.388349 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-6c48a324-ff18-43c7-a5f2-e578ffef9c7c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:11.396682 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6c48a324-ff18-43c7-a5f2-e578ffef9c7c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:11.397412 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6c48a324-ff18-43c7-a5f2-e578ffef9c7c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:11.398182 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6c48a324-ff18-43c7-a5f2-e578ffef9c7c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:11.399914 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6c48a324-ff18-43c7-a5f2-e578ffef9c7c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:11.435477 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-7dbad371-16d5-45a2-bb82-aa1be6b5e483 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:11.436673 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-7dbad371-16d5-45a2-bb82-aa1be6b5e483 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:11.451087 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7dbad371-16d5-45a2-bb82-aa1be6b5e483 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:11.451718 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7dbad371-16d5-45a2-bb82-aa1be6b5e483 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:11.452648 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7dbad371-16d5-45a2-bb82-aa1be6b5e483 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:11.453264 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7dbad371-16d5-45a2-bb82-aa1be6b5e483 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:11.739114 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-6c48a324-ff18-43c7-a5f2-e578ffef9c7c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:11.748180 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-6c48a324-ff18-43c7-a5f2-e578ffef9c7c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.365936 Jul 12 14:40:11.749020 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 65/132] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:11 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:11.754149 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e66821cc-f752-430c-9317-03683620709d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:11.754832 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-e66821cc-f752-430c-9317-03683620709d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:11.760277 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-7dbad371-16d5-45a2-bb82-aa1be6b5e483 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:11.762800 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e66821cc-f752-430c-9317-03683620709d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:11.763504 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e66821cc-f752-430c-9317-03683620709d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:11.764997 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e66821cc-f752-430c-9317-03683620709d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:11.765842 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e66821cc-f752-430c-9317-03683620709d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:11.772702 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-7dbad371-16d5-45a2-bb82-aa1be6b5e483 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1315 microversion: 2.1 time: 0.341715 Jul 12 14:40:11.781572 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 68/133] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:11 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:11.781572 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-3188dd8f-5539-46d9-b0a1-b7ef7281037b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:11.781572 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-3188dd8f-5539-46d9-b0a1-b7ef7281037b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:11.786887 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3188dd8f-5539-46d9-b0a1-b7ef7281037b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:11.787380 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3188dd8f-5539-46d9-b0a1-b7ef7281037b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:11.788106 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3188dd8f-5539-46d9-b0a1-b7ef7281037b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:11.789119 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3188dd8f-5539-46d9-b0a1-b7ef7281037b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:12.108796 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-3188dd8f-5539-46d9-b0a1-b7ef7281037b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:12.116604 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-3188dd8f-5539-46d9-b0a1-b7ef7281037b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.341536 Jul 12 14:40:12.118977 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 69/134] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:11 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:12.124141 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e66821cc-f752-430c-9317-03683620709d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:12.135858 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e66821cc-f752-430c-9317-03683620709d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:12.138398 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e66821cc-f752-430c-9317-03683620709d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:12.139763 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-e66821cc-f752-430c-9317-03683620709d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.389517 Jul 12 14:40:12.140376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 66/135] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:11 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:40:12.767782 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-e1a5bed6-8ba1-4160-a93a-a1d4924ac16d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:12.768615 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-e1a5bed6-8ba1-4160-a93a-a1d4924ac16d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:12.775200 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e1a5bed6-8ba1-4160-a93a-a1d4924ac16d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:12.775882 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e1a5bed6-8ba1-4160-a93a-a1d4924ac16d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:12.776893 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e1a5bed6-8ba1-4160-a93a-a1d4924ac16d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:12.777588 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e1a5bed6-8ba1-4160-a93a-a1d4924ac16d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:12.792281 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-a1a977d1-6a5c-4eae-9c34-d2421cee2766 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:12.794671 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-a1a977d1-6a5c-4eae-9c34-d2421cee2766 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:12.805528 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a1a977d1-6a5c-4eae-9c34-d2421cee2766 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:12.806938 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a1a977d1-6a5c-4eae-9c34-d2421cee2766 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:12.807799 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a1a977d1-6a5c-4eae-9c34-d2421cee2766 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:12.811169 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a1a977d1-6a5c-4eae-9c34-d2421cee2766 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:13.159045 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-e1a5bed6-8ba1-4160-a93a-a1d4924ac16d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:13.167698 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-e1a5bed6-8ba1-4160-a93a-a1d4924ac16d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.406532 Jul 12 14:40:13.168306 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 70/136] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:12 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:13.177929 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0d8858df-9710-4af1-aa8b-034388c7c138 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:13.178880 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-0d8858df-9710-4af1-aa8b-034388c7c138 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:13.185280 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0d8858df-9710-4af1-aa8b-034388c7c138 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:13.185728 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0d8858df-9710-4af1-aa8b-034388c7c138 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:13.186174 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-a1a977d1-6a5c-4eae-9c34-d2421cee2766 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:13.186483 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0d8858df-9710-4af1-aa8b-034388c7c138 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:13.187415 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0d8858df-9710-4af1-aa8b-034388c7c138 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:13.196223 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-a1a977d1-6a5c-4eae-9c34-d2421cee2766 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1315 microversion: 2.1 time: 0.407980 Jul 12 14:40:13.196792 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 67/137] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:12 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:13.202417 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-2dd46f5f-d497-49ee-a1d7-d1ec15168f15 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:13.203230 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-2dd46f5f-d497-49ee-a1d7-d1ec15168f15 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:13.210386 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2dd46f5f-d497-49ee-a1d7-d1ec15168f15 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:13.210913 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2dd46f5f-d497-49ee-a1d7-d1ec15168f15 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:13.211760 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2dd46f5f-d497-49ee-a1d7-d1ec15168f15 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:13.212264 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2dd46f5f-d497-49ee-a1d7-d1ec15168f15 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:13.459132 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-0d8858df-9710-4af1-aa8b-034388c7c138 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:13.467237 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-0d8858df-9710-4af1-aa8b-034388c7c138 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.297866 Jul 12 14:40:13.467905 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 71/138] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:13 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:13.475065 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-2dd46f5f-d497-49ee-a1d7-d1ec15168f15 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:13.485206 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-2dd46f5f-d497-49ee-a1d7-d1ec15168f15 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:13.487282 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-2dd46f5f-d497-49ee-a1d7-d1ec15168f15 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:13.488653 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-2dd46f5f-d497-49ee-a1d7-d1ec15168f15 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.290677 Jul 12 14:40:13.489724 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 68/139] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:13 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:40:14.184263 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-d0384ff9-3eba-46bc-83d5-ee953105f153 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:14.184875 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-d0384ff9-3eba-46bc-83d5-ee953105f153 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:14.190931 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d0384ff9-3eba-46bc-83d5-ee953105f153 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:14.191386 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d0384ff9-3eba-46bc-83d5-ee953105f153 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:14.192151 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d0384ff9-3eba-46bc-83d5-ee953105f153 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:14.192590 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d0384ff9-3eba-46bc-83d5-ee953105f153 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:14.212867 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-7bf9196f-f236-4024-98b9-acd24e59ce32 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:14.213501 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-7bf9196f-f236-4024-98b9-acd24e59ce32 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:14.220366 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7bf9196f-f236-4024-98b9-acd24e59ce32 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:14.220850 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7bf9196f-f236-4024-98b9-acd24e59ce32 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:14.221636 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7bf9196f-f236-4024-98b9-acd24e59ce32 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:14.222072 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7bf9196f-f236-4024-98b9-acd24e59ce32 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:14.425945 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-d0384ff9-3eba-46bc-83d5-ee953105f153 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:14.446806 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-d0384ff9-3eba-46bc-83d5-ee953105f153 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.266226 Jul 12 14:40:14.456429 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 72/140] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:14 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:14.456724 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7bf9196f-f236-4024-98b9-acd24e59ce32 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:14.458972 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-7bf9196f-f236-4024-98b9-acd24e59ce32 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1315 microversion: 2.1 time: 0.249991 Jul 12 14:40:14.459539 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 69/141] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:14 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:14.492590 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-9f81b715-9378-43de-a7e0-3688725b759c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:14.497442 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-9f81b715-9378-43de-a7e0-3688725b759c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:14.507823 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-39c80be0-528e-4da7-95dc-08d301aa2b72 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:14.508684 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-39c80be0-528e-4da7-95dc-08d301aa2b72 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:14.516098 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9f81b715-9378-43de-a7e0-3688725b759c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:14.516560 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9f81b715-9378-43de-a7e0-3688725b759c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:14.516885 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-39c80be0-528e-4da7-95dc-08d301aa2b72 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:14.517351 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-39c80be0-528e-4da7-95dc-08d301aa2b72 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:14.518119 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-39c80be0-528e-4da7-95dc-08d301aa2b72 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:14.518552 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-39c80be0-528e-4da7-95dc-08d301aa2b72 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:14.522189 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9f81b715-9378-43de-a7e0-3688725b759c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:14.522701 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9f81b715-9378-43de-a7e0-3688725b759c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:14.819374 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-9f81b715-9378-43de-a7e0-3688725b759c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:14.831715 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-9f81b715-9378-43de-a7e0-3688725b759c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.351442 Jul 12 14:40:14.840882 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 73/142] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:14 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:14.841415 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-39c80be0-528e-4da7-95dc-08d301aa2b72 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:14.849589 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-39c80be0-528e-4da7-95dc-08d301aa2b72 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:14.851447 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-39c80be0-528e-4da7-95dc-08d301aa2b72 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:14.852808 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-39c80be0-528e-4da7-95dc-08d301aa2b72 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.349163 Jul 12 14:40:14.864365 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 70/143] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:14 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:40:15.467963 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-2a1de93b-0573-429b-b710-67416f8007f8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:15.469234 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-2a1de93b-0573-429b-b710-67416f8007f8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:15.475895 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-7a901e5a-8585-4831-a96c-f9bc1adeceab tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:15.476501 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-7a901e5a-8585-4831-a96c-f9bc1adeceab tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:15.478059 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2a1de93b-0573-429b-b710-67416f8007f8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:15.478757 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2a1de93b-0573-429b-b710-67416f8007f8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:15.479735 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2a1de93b-0573-429b-b710-67416f8007f8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:15.480357 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2a1de93b-0573-429b-b710-67416f8007f8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:15.503747 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7a901e5a-8585-4831-a96c-f9bc1adeceab tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:15.503747 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7a901e5a-8585-4831-a96c-f9bc1adeceab tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:15.503747 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7a901e5a-8585-4831-a96c-f9bc1adeceab tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:15.503747 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7a901e5a-8585-4831-a96c-f9bc1adeceab tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:15.506662 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=100 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:15.753014 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-2a1de93b-0573-429b-b710-67416f8007f8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:15.763014 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-2a1de93b-0573-429b-b710-67416f8007f8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.302858 Jul 12 14:40:15.764026 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 74/144] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:15 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:15.801681 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7a901e5a-8585-4831-a96c-f9bc1adeceab tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:15.810409 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-7a901e5a-8585-4831-a96c-f9bc1adeceab tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1315 microversion: 2.1 time: 0.338129 Jul 12 14:40:15.811876 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 71/145] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:15 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:15.848154 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-a50f19b9-8152-4d7c-b2bf-4d512f92e8ce tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:15.848754 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-a50f19b9-8152-4d7c-b2bf-4d512f92e8ce tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:15.854880 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a50f19b9-8152-4d7c-b2bf-4d512f92e8ce tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:15.855317 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a50f19b9-8152-4d7c-b2bf-4d512f92e8ce tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:15.856059 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a50f19b9-8152-4d7c-b2bf-4d512f92e8ce tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:15.856485 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a50f19b9-8152-4d7c-b2bf-4d512f92e8ce tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:15.861079 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=100 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:16.022353 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-a50f19b9-8152-4d7c-b2bf-4d512f92e8ce tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:16.030298 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-a50f19b9-8152-4d7c-b2bf-4d512f92e8ce tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.185855 Jul 12 14:40:16.031064 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 72/146] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:15 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:16.035855 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-640adba2-d20a-4a66-85a9-d79bd5dc49f2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:16.036700 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-640adba2-d20a-4a66-85a9-d79bd5dc49f2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:16.044133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-cac8c475-2ad1-4927-a757-ebdca04e8bd9 req-5055901a-f3c0-400e-8403-6c419fe4ad8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e8ad66c-747a-4266-9452-a45bfeefa6c7", "name": "network-vif-plugged", "status": "completed", "tag": "fc527dbc-5958-4a00-a992-5b997bbfade2"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:40:16.044321 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-640adba2-d20a-4a66-85a9-d79bd5dc49f2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:16.045035 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-640adba2-d20a-4a66-85a9-d79bd5dc49f2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:16.045888 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-640adba2-d20a-4a66-85a9-d79bd5dc49f2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:16.046484 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-640adba2-d20a-4a66-85a9-d79bd5dc49f2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:16.054989 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-cac8c475-2ad1-4927-a757-ebdca04e8bd9 req-5055901a-f3c0-400e-8403-6c419fe4ad8d service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:16.055437 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-cac8c475-2ad1-4927-a757-ebdca04e8bd9 req-5055901a-f3c0-400e-8403-6c419fe4ad8d service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:16.089472 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-cac8c475-2ad1-4927-a757-ebdca04e8bd9 req-5055901a-f3c0-400e-8403-6c419fe4ad8d service nova] Creating event network-vif-plugged:fc527dbc-5958-4a00-a992-5b997bbfade2 for instance 2e8ad66c-747a-4266-9452-a45bfeefa6c7 on hv-cinder-82002 Jul 12 14:40:16.101885 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-cac8c475-2ad1-4927-a757-ebdca04e8bd9 req-5055901a-f3c0-400e-8403-6c419fe4ad8d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.334123 Jul 12 14:40:16.102515 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 75/147] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:40:16.224080 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-640adba2-d20a-4a66-85a9-d79bd5dc49f2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:16.234222 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-640adba2-d20a-4a66-85a9-d79bd5dc49f2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:16.238678 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-640adba2-d20a-4a66-85a9-d79bd5dc49f2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:16.243837 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-640adba2-d20a-4a66-85a9-d79bd5dc49f2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.208205 Jul 12 14:40:16.243837 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 73/148] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:16 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:40:16.780569 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-72f6d6be-b73d-4a91-b479-e0ae4e9ad85a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:16.781295 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-72f6d6be-b73d-4a91-b479-e0ae4e9ad85a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:16.788139 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-72f6d6be-b73d-4a91-b479-e0ae4e9ad85a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:16.790322 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-72f6d6be-b73d-4a91-b479-e0ae4e9ad85a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:16.791098 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-72f6d6be-b73d-4a91-b479-e0ae4e9ad85a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:16.791536 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-72f6d6be-b73d-4a91-b479-e0ae4e9ad85a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:16.826947 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-33d08285-09ba-4c23-bba6-09bd80560ade tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:16.827561 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-33d08285-09ba-4c23-bba6-09bd80560ade tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:16.840125 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-33d08285-09ba-4c23-bba6-09bd80560ade tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:16.841245 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-33d08285-09ba-4c23-bba6-09bd80560ade tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:16.841597 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-33d08285-09ba-4c23-bba6-09bd80560ade tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:16.842059 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-33d08285-09ba-4c23-bba6-09bd80560ade tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:17.009603 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-72f6d6be-b73d-4a91-b479-e0ae4e9ad85a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:17.023083 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-72f6d6be-b73d-4a91-b479-e0ae4e9ad85a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.246659 Jul 12 14:40:17.024474 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 76/149] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:16 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:17.038303 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-33d08285-09ba-4c23-bba6-09bd80560ade tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:17.047278 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-33d08285-09ba-4c23-bba6-09bd80560ade tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1315 microversion: 2.1 time: 0.224017 Jul 12 14:40:17.047851 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 74/150] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:16 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:17.050983 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-c990c579-d1b7-4b4f-aa98-c8f83687559f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:17.051816 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-c990c579-d1b7-4b4f-aa98-c8f83687559f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:17.061670 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c990c579-d1b7-4b4f-aa98-c8f83687559f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:17.062712 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c990c579-d1b7-4b4f-aa98-c8f83687559f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:17.064015 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c990c579-d1b7-4b4f-aa98-c8f83687559f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:17.064792 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c990c579-d1b7-4b4f-aa98-c8f83687559f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:17.240522 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-c990c579-d1b7-4b4f-aa98-c8f83687559f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:17.256358 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-c990c579-d1b7-4b4f-aa98-c8f83687559f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.212193 Jul 12 14:40:17.257192 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 77/151] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:17 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:17.266209 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e60a8aec-57fd-4545-9c66-76fe293dce23 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:17.266209 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-e60a8aec-57fd-4545-9c66-76fe293dce23 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:17.268084 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e60a8aec-57fd-4545-9c66-76fe293dce23 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:17.268710 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e60a8aec-57fd-4545-9c66-76fe293dce23 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:17.269588 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e60a8aec-57fd-4545-9c66-76fe293dce23 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:17.269963 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e60a8aec-57fd-4545-9c66-76fe293dce23 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:17.412237 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e60a8aec-57fd-4545-9c66-76fe293dce23 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:17.421950 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e60a8aec-57fd-4545-9c66-76fe293dce23 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:17.423465 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e60a8aec-57fd-4545-9c66-76fe293dce23 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:17.424569 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-e60a8aec-57fd-4545-9c66-76fe293dce23 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.168507 Jul 12 14:40:17.434918 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 75/152] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:17 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:40:18.039644 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-752bba2f-0bf8-4c04-811d-0872f697a1f2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:18.040252 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-752bba2f-0bf8-4c04-811d-0872f697a1f2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:18.046927 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-752bba2f-0bf8-4c04-811d-0872f697a1f2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:18.047383 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-752bba2f-0bf8-4c04-811d-0872f697a1f2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:18.048287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-752bba2f-0bf8-4c04-811d-0872f697a1f2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:18.048575 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-752bba2f-0bf8-4c04-811d-0872f697a1f2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:18.064732 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-ae432524-ea8d-4b0d-8b14-e71f639a646c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:18.065420 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-ae432524-ea8d-4b0d-8b14-e71f639a646c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:18.071593 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ae432524-ea8d-4b0d-8b14-e71f639a646c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:18.072079 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ae432524-ea8d-4b0d-8b14-e71f639a646c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:18.073106 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ae432524-ea8d-4b0d-8b14-e71f639a646c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:18.073835 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ae432524-ea8d-4b0d-8b14-e71f639a646c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:18.265579 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-ae432524-ea8d-4b0d-8b14-e71f639a646c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:18.268285 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-752bba2f-0bf8-4c04-811d-0872f697a1f2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:18.281401 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-ae432524-ea8d-4b0d-8b14-e71f639a646c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1315 microversion: 2.1 time: 0.214373 Jul 12 14:40:18.281401 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 76/153] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:18 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:18.282049 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-752bba2f-0bf8-4c04-811d-0872f697a1f2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.242098 Jul 12 14:40:18.282461 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-462883ba-156b-4326-913b-6f1a54ed8334 req-3e725fbc-58cc-4c15-a265-c648783222c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be1b083-8bbf-47a2-bcd3-015cd173afa1", "name": "network-vif-plugged", "status": "completed", "tag": "f286bedd-3258-42e6-b8d5-c69bf1cec4da"}, {"server_uuid": "4c32aaf0-6aa0-4298-aa4b-a285af8940c7", "name": "network-vif-plugged", "status": "completed", "tag": "148d0905-282d-448c-899b-1f113dada0e4"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:40:18.289186 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-462883ba-156b-4326-913b-6f1a54ed8334 req-3e725fbc-58cc-4c15-a265-c648783222c5 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:18.289693 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-462883ba-156b-4326-913b-6f1a54ed8334 req-3e725fbc-58cc-4c15-a265-c648783222c5 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:18.295306 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 78/154] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:18 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:18.302669 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-b0f6b08c-71fc-41a1-8313-afe5fb217b82 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:18.303490 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-b0f6b08c-71fc-41a1-8313-afe5fb217b82 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:18.305578 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-462883ba-156b-4326-913b-6f1a54ed8334 req-3e725fbc-58cc-4c15-a265-c648783222c5 service nova] Creating event network-vif-plugged:f286bedd-3258-42e6-b8d5-c69bf1cec4da for instance 4be1b083-8bbf-47a2-bcd3-015cd173afa1 on hv-cinder-82002 Jul 12 14:40:18.309943 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-462883ba-156b-4326-913b-6f1a54ed8334 req-3e725fbc-58cc-4c15-a265-c648783222c5 service nova] Creating event network-vif-plugged:148d0905-282d-448c-899b-1f113dada0e4 for instance 4c32aaf0-6aa0-4298-aa4b-a285af8940c7 on hv-cinder-82002 Jul 12 14:40:18.311867 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b0f6b08c-71fc-41a1-8313-afe5fb217b82 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:18.312456 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b0f6b08c-71fc-41a1-8313-afe5fb217b82 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:18.313243 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b0f6b08c-71fc-41a1-8313-afe5fb217b82 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:18.313681 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b0f6b08c-71fc-41a1-8313-afe5fb217b82 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:18.313786 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-462883ba-156b-4326-913b-6f1a54ed8334 req-3e725fbc-58cc-4c15-a265-c648783222c5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037020 Jul 12 14:40:18.314289 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 77/155] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:40:18.445397 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-01b68d2f-9fb9-45d8-b1d5-142c076ceace tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:18.446661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-01b68d2f-9fb9-45d8-b1d5-142c076ceace tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:18.454293 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-01b68d2f-9fb9-45d8-b1d5-142c076ceace tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:18.454733 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-01b68d2f-9fb9-45d8-b1d5-142c076ceace tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:18.455705 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-01b68d2f-9fb9-45d8-b1d5-142c076ceace tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:18.456139 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-01b68d2f-9fb9-45d8-b1d5-142c076ceace tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:18.464906 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-b0f6b08c-71fc-41a1-8313-afe5fb217b82 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:18.472984 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-b0f6b08c-71fc-41a1-8313-afe5fb217b82 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.176395 Jul 12 14:40:18.476565 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 79/156] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:18 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:18.608530 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-01b68d2f-9fb9-45d8-b1d5-142c076ceace tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:18.617640 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-01b68d2f-9fb9-45d8-b1d5-142c076ceace tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:18.619124 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-01b68d2f-9fb9-45d8-b1d5-142c076ceace tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:18.620293 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-01b68d2f-9fb9-45d8-b1d5-142c076ceace tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.180604 Jul 12 14:40:18.620896 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 78/157] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:18 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:40:19.291174 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ba802d11-221d-4f9f-b044-4f3e05e5392d tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:19.291912 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-ba802d11-221d-4f9f-b044-4f3e05e5392d tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:19.294157 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_api:SELECT=91 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:19.294276 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d6b1d3b2-1ba2-409e-a950-8389bbbaaa56 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:19.294981 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-d6b1d3b2-1ba2-409e-a950-8389bbbaaa56 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:19.301212 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ba802d11-221d-4f9f-b044-4f3e05e5392d tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:19.303629 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d6b1d3b2-1ba2-409e-a950-8389bbbaaa56 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:19.304073 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d6b1d3b2-1ba2-409e-a950-8389bbbaaa56 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:19.304866 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d6b1d3b2-1ba2-409e-a950-8389bbbaaa56 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:19.308331 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d6b1d3b2-1ba2-409e-a950-8389bbbaaa56 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:19.313614 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ba802d11-221d-4f9f-b044-4f3e05e5392d tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:19.314488 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ba802d11-221d-4f9f-b044-4f3e05e5392d tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:19.314935 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ba802d11-221d-4f9f-b044-4f3e05e5392d tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:19.504517 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d6b1d3b2-1ba2-409e-a950-8389bbbaaa56 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:19.512023 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-d6b1d3b2-1ba2-409e-a950-8389bbbaaa56 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.221449 Jul 12 14:40:19.512655 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 79/158] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:19 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:19.517316 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ba802d11-221d-4f9f-b044-4f3e05e5392d tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:19.518267 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-37d53202-a028-47f4-88e3-fb63c0489fdd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:19.518861 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-37d53202-a028-47f4-88e3-fb63c0489fdd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:19.525202 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-37d53202-a028-47f4-88e3-fb63c0489fdd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:19.525658 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-37d53202-a028-47f4-88e3-fb63c0489fdd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:19.525764 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ba802d11-221d-4f9f-b044-4f3e05e5392d tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1315 microversion: 2.1 time: 0.238340 Jul 12 14:40:19.526275 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 80/159] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:19 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:19.526449 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-37d53202-a028-47f4-88e3-fb63c0489fdd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:19.526905 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-37d53202-a028-47f4-88e3-fb63c0489fdd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:19.639459 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-4a7ae731-505f-45c2-90b7-f8d2d4c05398 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:19.640071 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-4a7ae731-505f-45c2-90b7-f8d2d4c05398 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:19.646911 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4a7ae731-505f-45c2-90b7-f8d2d4c05398 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:19.647524 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4a7ae731-505f-45c2-90b7-f8d2d4c05398 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:19.648510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4a7ae731-505f-45c2-90b7-f8d2d4c05398 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:19.651745 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4a7ae731-505f-45c2-90b7-f8d2d4c05398 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:19.672483 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-37d53202-a028-47f4-88e3-fb63c0489fdd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:19.682219 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-37d53202-a028-47f4-88e3-fb63c0489fdd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.167368 Jul 12 14:40:19.682800 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 80/160] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:19 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:19.791311 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-4a7ae731-505f-45c2-90b7-f8d2d4c05398 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:19.799724 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-4a7ae731-505f-45c2-90b7-f8d2d4c05398 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:19.801248 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-4a7ae731-505f-45c2-90b7-f8d2d4c05398 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:19.802374 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-4a7ae731-505f-45c2-90b7-f8d2d4c05398 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.167448 Jul 12 14:40:19.802883 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 81/161] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:19 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:40:20.530601 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d15f7115-f2af-46b3-993a-c8491f350b3b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:20.531751 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-d15f7115-f2af-46b3-993a-c8491f350b3b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:20.539152 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d15f7115-f2af-46b3-993a-c8491f350b3b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:20.539801 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d15f7115-f2af-46b3-993a-c8491f350b3b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:20.540932 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d15f7115-f2af-46b3-993a-c8491f350b3b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:20.541589 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d15f7115-f2af-46b3-993a-c8491f350b3b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:20.543104 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-41b60103-c84d-40ca-8331-4b5390b56858 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:20.544195 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-41b60103-c84d-40ca-8331-4b5390b56858 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:20.558345 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-41b60103-c84d-40ca-8331-4b5390b56858 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:20.558628 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-41b60103-c84d-40ca-8331-4b5390b56858 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:20.561437 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-41b60103-c84d-40ca-8331-4b5390b56858 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:20.561927 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-41b60103-c84d-40ca-8331-4b5390b56858 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:20.760077 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d15f7115-f2af-46b3-993a-c8491f350b3b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:20.771179 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-d15f7115-f2af-46b3-993a-c8491f350b3b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.246028 Jul 12 14:40:20.771999 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 81/162] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:20 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:20.782127 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-8917a044-312b-44ab-a528-670a1e81bbda req-fedac39a-901e-4a1c-a0af-18f9161e0873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8f59b92-aa7f-496d-a19c-9035a4948560", "name": "network-vif-plugged", "status": "completed", "tag": "68fcc4b4-c1bb-4548-816a-03ac719e76aa"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:40:20.793837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-41b60103-c84d-40ca-8331-4b5390b56858 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:20.794507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-8917a044-312b-44ab-a528-670a1e81bbda req-fedac39a-901e-4a1c-a0af-18f9161e0873 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:20.794915 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-8917a044-312b-44ab-a528-670a1e81bbda req-fedac39a-901e-4a1c-a0af-18f9161e0873 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:20.808525 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-8917a044-312b-44ab-a528-670a1e81bbda req-fedac39a-901e-4a1c-a0af-18f9161e0873 service nova] Creating event network-vif-plugged:68fcc4b4-c1bb-4548-816a-03ac719e76aa for instance b8f59b92-aa7f-496d-a19c-9035a4948560 on hv-cinder-82002 Jul 12 14:40:20.814686 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-8917a044-312b-44ab-a528-670a1e81bbda req-fedac39a-901e-4a1c-a0af-18f9161e0873 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041759 Jul 12 14:40:20.815549 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 82/163] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:40:20.821128 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-41b60103-c84d-40ca-8331-4b5390b56858 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1315 microversion: 2.1 time: 0.281635 Jul 12 14:40:20.821867 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-369e322a-fd0a-4ad7-be05-8bb39d78ae51 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:20.822761 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-369e322a-fd0a-4ad7-be05-8bb39d78ae51 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:20.834043 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-369e322a-fd0a-4ad7-be05-8bb39d78ae51 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:20.834043 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-369e322a-fd0a-4ad7-be05-8bb39d78ae51 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:20.834043 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-369e322a-fd0a-4ad7-be05-8bb39d78ae51 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:20.834043 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-369e322a-fd0a-4ad7-be05-8bb39d78ae51 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:20.834358 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 82/164] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:20 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:20.840800 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-1b649e79-5435-4fd7-a7f7-43ec4b0c22a5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:20.841467 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-1b649e79-5435-4fd7-a7f7-43ec4b0c22a5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:20.863584 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1b649e79-5435-4fd7-a7f7-43ec4b0c22a5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:20.864258 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1b649e79-5435-4fd7-a7f7-43ec4b0c22a5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:20.871166 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1b649e79-5435-4fd7-a7f7-43ec4b0c22a5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:20.871166 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1b649e79-5435-4fd7-a7f7-43ec4b0c22a5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:21.161514 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-1b649e79-5435-4fd7-a7f7-43ec4b0c22a5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:21.175471 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-1b649e79-5435-4fd7-a7f7-43ec4b0c22a5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:21.177180 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-1b649e79-5435-4fd7-a7f7-43ec4b0c22a5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:21.178043 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-369e322a-fd0a-4ad7-be05-8bb39d78ae51 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:21.178467 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-1b649e79-5435-4fd7-a7f7-43ec4b0c22a5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.341974 Jul 12 14:40:21.179227 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 83/165] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:20 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:40:21.187867 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-369e322a-fd0a-4ad7-be05-8bb39d78ae51 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.370981 Jul 12 14:40:21.188665 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 83/166] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:20 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:21.787800 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-a299f7de-a6ac-449e-aeed-51d182123e51 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:21.788408 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-a299f7de-a6ac-449e-aeed-51d182123e51 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:21.795652 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a299f7de-a6ac-449e-aeed-51d182123e51 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:21.796108 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a299f7de-a6ac-449e-aeed-51d182123e51 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:21.796927 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a299f7de-a6ac-449e-aeed-51d182123e51 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:21.797550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a299f7de-a6ac-449e-aeed-51d182123e51 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:21.838481 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-399fec87-aaaa-4826-9492-accb39beec8a tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:21.847808 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-399fec87-aaaa-4826-9492-accb39beec8a tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:21.849570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-399fec87-aaaa-4826-9492-accb39beec8a tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:21.850335 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-399fec87-aaaa-4826-9492-accb39beec8a tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:21.851597 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-399fec87-aaaa-4826-9492-accb39beec8a tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:21.852181 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-399fec87-aaaa-4826-9492-accb39beec8a tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:22.180960 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-a299f7de-a6ac-449e-aeed-51d182123e51 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:22.185770 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-399fec87-aaaa-4826-9492-accb39beec8a tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:22.189264 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-a299f7de-a6ac-449e-aeed-51d182123e51 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.405330 Jul 12 14:40:22.190063 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 84/167] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:21 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:22.194153 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-399fec87-aaaa-4826-9492-accb39beec8a tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1315 microversion: 2.1 time: 0.359455 Jul 12 14:40:22.203344 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 84/168] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:21 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:22.205114 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-9efa865c-77c5-4fc7-b23f-e67e87831a45 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:22.205528 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-bcfb6f4e-bb56-48fc-8ef0-89a331c43aee tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:22.205738 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-9efa865c-77c5-4fc7-b23f-e67e87831a45 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:22.206804 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-bcfb6f4e-bb56-48fc-8ef0-89a331c43aee tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:22.211754 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9efa865c-77c5-4fc7-b23f-e67e87831a45 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:22.212202 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9efa865c-77c5-4fc7-b23f-e67e87831a45 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:22.213049 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9efa865c-77c5-4fc7-b23f-e67e87831a45 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:22.213505 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9efa865c-77c5-4fc7-b23f-e67e87831a45 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:22.215196 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bcfb6f4e-bb56-48fc-8ef0-89a331c43aee tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:22.215966 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bcfb6f4e-bb56-48fc-8ef0-89a331c43aee tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:22.216928 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bcfb6f4e-bb56-48fc-8ef0-89a331c43aee tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:22.217598 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bcfb6f4e-bb56-48fc-8ef0-89a331c43aee tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:22.407753 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-9efa865c-77c5-4fc7-b23f-e67e87831a45 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:22.417724 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-9efa865c-77c5-4fc7-b23f-e67e87831a45 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:22.421788 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-9efa865c-77c5-4fc7-b23f-e67e87831a45 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:22.424035 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-9efa865c-77c5-4fc7-b23f-e67e87831a45 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.222690 Jul 12 14:40:22.425039 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 85/169] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:22 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:40:22.441507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-bcfb6f4e-bb56-48fc-8ef0-89a331c43aee tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:22.446922 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-bcfb6f4e-bb56-48fc-8ef0-89a331c43aee tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.245594 Jul 12 14:40:22.447501 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 85/170] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:22 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:22.853605 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-31abdde5-f319-4751-8f67-59441f0682eb req-a97b0dab-8a36-4fe2-9778-4e5f580d18cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26eeea2d-c1c2-46a7-b727-269cf6dce92a", "name": "network-vif-plugged", "status": "completed", "tag": "f0edff70-5e51-412d-b474-2a70b09725f5"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:40:22.861604 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-31abdde5-f319-4751-8f67-59441f0682eb req-a97b0dab-8a36-4fe2-9778-4e5f580d18cb service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:22.862048 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-31abdde5-f319-4751-8f67-59441f0682eb req-a97b0dab-8a36-4fe2-9778-4e5f580d18cb service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:22.872894 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-31abdde5-f319-4751-8f67-59441f0682eb req-a97b0dab-8a36-4fe2-9778-4e5f580d18cb service nova] Creating event network-vif-plugged:f0edff70-5e51-412d-b474-2a70b09725f5 for instance 26eeea2d-c1c2-46a7-b727-269cf6dce92a on hv-cinder-82002 Jul 12 14:40:22.881678 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-31abdde5-f319-4751-8f67-59441f0682eb req-a97b0dab-8a36-4fe2-9778-4e5f580d18cb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031551 Jul 12 14:40:22.882291 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 86/171] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:40:23.206709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-5b58148e-9eab-48a0-a5bd-53df82b27993 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:23.207316 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-5b58148e-9eab-48a0-a5bd-53df82b27993 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:23.212177 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0b3c5c6a-95fc-4c9c-9200-34367c6edc24 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:23.212881 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-0b3c5c6a-95fc-4c9c-9200-34367c6edc24 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:23.213450 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5b58148e-9eab-48a0-a5bd-53df82b27993 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:23.213904 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5b58148e-9eab-48a0-a5bd-53df82b27993 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:23.214654 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5b58148e-9eab-48a0-a5bd-53df82b27993 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:23.215240 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5b58148e-9eab-48a0-a5bd-53df82b27993 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:23.219500 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0b3c5c6a-95fc-4c9c-9200-34367c6edc24 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:23.219951 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0b3c5c6a-95fc-4c9c-9200-34367c6edc24 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:23.220753 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0b3c5c6a-95fc-4c9c-9200-34367c6edc24 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:23.221395 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0b3c5c6a-95fc-4c9c-9200-34367c6edc24 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:23.406275 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-5b58148e-9eab-48a0-a5bd-53df82b27993 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:23.416593 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-5b58148e-9eab-48a0-a5bd-53df82b27993 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.213748 Jul 12 14:40:23.417333 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-0b3c5c6a-95fc-4c9c-9200-34367c6edc24 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:23.426093 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-0b3c5c6a-95fc-4c9c-9200-34367c6edc24 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1315 microversion: 2.1 time: 0.219064 Jul 12 14:40:23.426889 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 86/172] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:23 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:23.433607 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 87/173] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:23 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:23.444858 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-8e1b5638-73ef-4b5d-a997-008bf36af6f8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:23.446370 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-8e1b5638-73ef-4b5d-a997-008bf36af6f8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:23.452394 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8e1b5638-73ef-4b5d-a997-008bf36af6f8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:23.452841 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8e1b5638-73ef-4b5d-a997-008bf36af6f8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:23.453627 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8e1b5638-73ef-4b5d-a997-008bf36af6f8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:23.454058 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8e1b5638-73ef-4b5d-a997-008bf36af6f8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:23.463497 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-cf7b62d0-8483-44c5-ad35-e57e9eb82d78 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:23.464103 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-cf7b62d0-8483-44c5-ad35-e57e9eb82d78 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:23.470615 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-cf7b62d0-8483-44c5-ad35-e57e9eb82d78 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:23.471061 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-cf7b62d0-8483-44c5-ad35-e57e9eb82d78 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:23.473935 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-cf7b62d0-8483-44c5-ad35-e57e9eb82d78 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:23.473935 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-cf7b62d0-8483-44c5-ad35-e57e9eb82d78 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:23.657881 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-8e1b5638-73ef-4b5d-a997-008bf36af6f8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:23.670084 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-cf7b62d0-8483-44c5-ad35-e57e9eb82d78 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:23.675156 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-8e1b5638-73ef-4b5d-a997-008bf36af6f8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:23.677138 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-8e1b5638-73ef-4b5d-a997-008bf36af6f8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:23.678145 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-cf7b62d0-8483-44c5-ad35-e57e9eb82d78 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.218208 Jul 12 14:40:23.678295 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-8e1b5638-73ef-4b5d-a997-008bf36af6f8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.240104 Jul 12 14:40:23.678850 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 87/174] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:23 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:40:23.687927 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 88/175] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:23 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:24.433307 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c8d87d8f-dce2-4f05-ae2e-22964bad7c5d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:24.435105 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-c8d87d8f-dce2-4f05-ae2e-22964bad7c5d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:24.443397 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-d53f82d4-6d8b-4656-9883-5e7600013b4a tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:24.445374 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c8d87d8f-dce2-4f05-ae2e-22964bad7c5d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:24.445820 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c8d87d8f-dce2-4f05-ae2e-22964bad7c5d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:24.446589 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c8d87d8f-dce2-4f05-ae2e-22964bad7c5d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:24.447418 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c8d87d8f-dce2-4f05-ae2e-22964bad7c5d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:24.447663 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-d53f82d4-6d8b-4656-9883-5e7600013b4a tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:24.454523 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d53f82d4-6d8b-4656-9883-5e7600013b4a tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:24.455184 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d53f82d4-6d8b-4656-9883-5e7600013b4a tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:24.456101 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d53f82d4-6d8b-4656-9883-5e7600013b4a tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:24.456803 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d53f82d4-6d8b-4656-9883-5e7600013b4a tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:24.647708 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c8d87d8f-dce2-4f05-ae2e-22964bad7c5d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:24.652269 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-d53f82d4-6d8b-4656-9883-5e7600013b4a tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:24.655417 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-c8d87d8f-dce2-4f05-ae2e-22964bad7c5d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.225904 Jul 12 14:40:24.656630 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 88/176] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:24 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:24.660279 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-d53f82d4-6d8b-4656-9883-5e7600013b4a tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1315 microversion: 2.1 time: 0.220777 Jul 12 14:40:24.660920 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 89/177] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:24 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:24.695578 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-0bc76bae-1c34-4dd8-8070-23a9c3c3a4a7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:24.696216 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-0bc76bae-1c34-4dd8-8070-23a9c3c3a4a7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:24.697382 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-8e5f6a0a-684c-4e92-81c7-42a60dd0de13 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:24.698069 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-8e5f6a0a-684c-4e92-81c7-42a60dd0de13 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:24.703408 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0bc76bae-1c34-4dd8-8070-23a9c3c3a4a7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:24.703848 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0bc76bae-1c34-4dd8-8070-23a9c3c3a4a7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:24.704599 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0bc76bae-1c34-4dd8-8070-23a9c3c3a4a7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:24.704707 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8e5f6a0a-684c-4e92-81c7-42a60dd0de13 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:24.705028 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0bc76bae-1c34-4dd8-8070-23a9c3c3a4a7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:24.705999 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8e5f6a0a-684c-4e92-81c7-42a60dd0de13 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:24.705999 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8e5f6a0a-684c-4e92-81c7-42a60dd0de13 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:24.706295 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8e5f6a0a-684c-4e92-81c7-42a60dd0de13 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:24.905291 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-0bc76bae-1c34-4dd8-8070-23a9c3c3a4a7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:24.909933 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-8e5f6a0a-684c-4e92-81c7-42a60dd0de13 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:24.914656 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-0bc76bae-1c34-4dd8-8070-23a9c3c3a4a7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.223205 Jul 12 14:40:24.915242 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 89/178] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:24 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:24.920863 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-8e5f6a0a-684c-4e92-81c7-42a60dd0de13 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:24.920863 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-8e5f6a0a-684c-4e92-81c7-42a60dd0de13 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:24.921088 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-8e5f6a0a-684c-4e92-81c7-42a60dd0de13 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.227841 Jul 12 14:40:24.921511 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 90/179] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:24 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:40:25.673729 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-77901a0b-8238-4ea7-a399-46eeb0d798b2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:25.674333 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-77901a0b-8238-4ea7-a399-46eeb0d798b2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:25.677839 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-eff75188-a07d-4e3e-9416-4e7af0123caa tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:25.678450 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-eff75188-a07d-4e3e-9416-4e7af0123caa tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:25.682454 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-77901a0b-8238-4ea7-a399-46eeb0d798b2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:25.682900 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-77901a0b-8238-4ea7-a399-46eeb0d798b2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:25.683959 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-77901a0b-8238-4ea7-a399-46eeb0d798b2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:25.684391 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-77901a0b-8238-4ea7-a399-46eeb0d798b2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:25.687886 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-eff75188-a07d-4e3e-9416-4e7af0123caa tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:25.689097 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-eff75188-a07d-4e3e-9416-4e7af0123caa tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:25.689357 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=100 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:25.689473 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-eff75188-a07d-4e3e-9416-4e7af0123caa tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:25.689978 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-eff75188-a07d-4e3e-9416-4e7af0123caa tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:25.892774 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-eff75188-a07d-4e3e-9416-4e7af0123caa tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:25.900607 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-eff75188-a07d-4e3e-9416-4e7af0123caa tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1315 microversion: 2.1 time: 0.227343 Jul 12 14:40:25.901290 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 91/180] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:25 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:25.910064 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-77901a0b-8238-4ea7-a399-46eeb0d798b2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:25.917619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-77901a0b-8238-4ea7-a399-46eeb0d798b2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.248570 Jul 12 14:40:25.918234 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 90/181] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:25 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:25.932735 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-6743c31f-4038-469b-9442-bf3493332e50 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:25.933384 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-6743c31f-4038-469b-9442-bf3493332e50 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:25.940472 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-0223507a-6fd6-4672-a822-c1f92c08a076 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:25.941369 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-0223507a-6fd6-4672-a822-c1f92c08a076 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:25.946276 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6743c31f-4038-469b-9442-bf3493332e50 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:25.946276 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6743c31f-4038-469b-9442-bf3493332e50 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:25.946276 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6743c31f-4038-469b-9442-bf3493332e50 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:25.946276 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6743c31f-4038-469b-9442-bf3493332e50 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:25.948614 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0223507a-6fd6-4672-a822-c1f92c08a076 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:25.949198 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0223507a-6fd6-4672-a822-c1f92c08a076 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:25.950057 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0223507a-6fd6-4672-a822-c1f92c08a076 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:25.950742 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0223507a-6fd6-4672-a822-c1f92c08a076 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:25.964557 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=100 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:26.158481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-6743c31f-4038-469b-9442-bf3493332e50 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:26.167311 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-0223507a-6fd6-4672-a822-c1f92c08a076 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:26.168694 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-6743c31f-4038-469b-9442-bf3493332e50 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.240569 Jul 12 14:40:26.171634 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 92/182] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:25 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:26.186755 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-0223507a-6fd6-4672-a822-c1f92c08a076 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:26.188437 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-0223507a-6fd6-4672-a822-c1f92c08a076 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:26.190304 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-0223507a-6fd6-4672-a822-c1f92c08a076 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.254812 Jul 12 14:40:26.190304 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 91/183] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:25 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:40:26.917732 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0b02ed4f-c8eb-401f-ac35-c89e722bd5f4 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:26.918347 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-0b02ed4f-c8eb-401f-ac35-c89e722bd5f4 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:26.924406 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0b02ed4f-c8eb-401f-ac35-c89e722bd5f4 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:26.924848 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0b02ed4f-c8eb-401f-ac35-c89e722bd5f4 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:26.925622 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0b02ed4f-c8eb-401f-ac35-c89e722bd5f4 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:26.926050 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0b02ed4f-c8eb-401f-ac35-c89e722bd5f4 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:26.935323 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-01b34c60-6c70-49b3-91c5-e96953e8c10b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:26.936386 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-01b34c60-6c70-49b3-91c5-e96953e8c10b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:26.939301 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_api:SELECT=100 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:26.942853 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-01b34c60-6c70-49b3-91c5-e96953e8c10b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:26.943291 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-01b34c60-6c70-49b3-91c5-e96953e8c10b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:26.944043 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-01b34c60-6c70-49b3-91c5-e96953e8c10b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:26.944469 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-01b34c60-6c70-49b3-91c5-e96953e8c10b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:27.123186 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-0b02ed4f-c8eb-401f-ac35-c89e722bd5f4 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:27.130075 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-01b34c60-6c70-49b3-91c5-e96953e8c10b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:27.130627 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-0b02ed4f-c8eb-401f-ac35-c89e722bd5f4 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1501 microversion: 2.1 time: 0.216690 Jul 12 14:40:27.131198 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 93/184] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:26 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1501 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:27.137623 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-01b34c60-6c70-49b3-91c5-e96953e8c10b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.206479 Jul 12 14:40:27.138770 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 92/185] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:26 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:27.188722 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-7752940d-294d-488e-b98e-66284b5865d2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:27.189368 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-7752940d-294d-488e-b98e-66284b5865d2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:27.195413 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7752940d-294d-488e-b98e-66284b5865d2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:27.195864 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7752940d-294d-488e-b98e-66284b5865d2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:27.196817 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7752940d-294d-488e-b98e-66284b5865d2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:27.197264 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7752940d-294d-488e-b98e-66284b5865d2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:27.212350 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-7a8484f5-ce5b-4943-ae8b-c24a366b88c5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:27.213044 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-7a8484f5-ce5b-4943-ae8b-c24a366b88c5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:27.219446 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7a8484f5-ce5b-4943-ae8b-c24a366b88c5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:27.219897 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7a8484f5-ce5b-4943-ae8b-c24a366b88c5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:27.220661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7a8484f5-ce5b-4943-ae8b-c24a366b88c5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:27.221096 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7a8484f5-ce5b-4943-ae8b-c24a366b88c5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:27.403161 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-7752940d-294d-488e-b98e-66284b5865d2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:27.410202 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7a8484f5-ce5b-4943-ae8b-c24a366b88c5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:27.410784 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-7752940d-294d-488e-b98e-66284b5865d2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.228616 Jul 12 14:40:27.411366 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 94/186] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:27 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:27.418381 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7a8484f5-ce5b-4943-ae8b-c24a366b88c5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:27.420475 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7a8484f5-ce5b-4943-ae8b-c24a366b88c5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:27.421595 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-7a8484f5-ce5b-4943-ae8b-c24a366b88c5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.218113 Jul 12 14:40:27.422141 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 93/187] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:27 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:40:28.155540 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-1c26df4e-ed89-430f-a607-11b486bd7adf tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:28.156178 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-1c26df4e-ed89-430f-a607-11b486bd7adf tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:28.162133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1c26df4e-ed89-430f-a607-11b486bd7adf tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:28.162579 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1c26df4e-ed89-430f-a607-11b486bd7adf tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:28.163331 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1c26df4e-ed89-430f-a607-11b486bd7adf tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:28.163761 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1c26df4e-ed89-430f-a607-11b486bd7adf tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:28.290426 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-1c26df4e-ed89-430f-a607-11b486bd7adf tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:28.297649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-1c26df4e-ed89-430f-a607-11b486bd7adf tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.146737 Jul 12 14:40:28.298221 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 95/188] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:28 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:28.427564 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-359c1e32-71ec-4f35-bbdd-492d6215ebed tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:28.428183 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-359c1e32-71ec-4f35-bbdd-492d6215ebed tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:28.435003 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-359c1e32-71ec-4f35-bbdd-492d6215ebed tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:28.435465 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-359c1e32-71ec-4f35-bbdd-492d6215ebed tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:28.436221 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-359c1e32-71ec-4f35-bbdd-492d6215ebed tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:28.436649 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-359c1e32-71ec-4f35-bbdd-492d6215ebed tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:28.439769 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-540a8e75-55ac-4195-9129-b473a136a304 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:28.440410 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-540a8e75-55ac-4195-9129-b473a136a304 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:28.446607 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-540a8e75-55ac-4195-9129-b473a136a304 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:28.447065 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-540a8e75-55ac-4195-9129-b473a136a304 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:28.447819 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-540a8e75-55ac-4195-9129-b473a136a304 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:28.448250 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-540a8e75-55ac-4195-9129-b473a136a304 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:28.631497 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-359c1e32-71ec-4f35-bbdd-492d6215ebed tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:28.634383 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-540a8e75-55ac-4195-9129-b473a136a304 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:28.639943 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-359c1e32-71ec-4f35-bbdd-492d6215ebed tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.216120 Jul 12 14:40:28.640521 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 94/189] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:28 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:28.642945 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-540a8e75-55ac-4195-9129-b473a136a304 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:28.644454 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-540a8e75-55ac-4195-9129-b473a136a304 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:28.645574 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-540a8e75-55ac-4195-9129-b473a136a304 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.209595 Jul 12 14:40:28.646120 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 96/190] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:28 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:40:29.314365 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-65e1c276-9fe4-45dd-840f-d7a6d9ab30de tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:29.314965 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-65e1c276-9fe4-45dd-840f-d7a6d9ab30de tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:29.320931 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-65e1c276-9fe4-45dd-840f-d7a6d9ab30de tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:29.321421 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-65e1c276-9fe4-45dd-840f-d7a6d9ab30de tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:29.322174 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-65e1c276-9fe4-45dd-840f-d7a6d9ab30de tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:29.322607 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-65e1c276-9fe4-45dd-840f-d7a6d9ab30de tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:29.810432 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-65e1c276-9fe4-45dd-840f-d7a6d9ab30de tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:29.810432 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-65e1c276-9fe4-45dd-840f-d7a6d9ab30de tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.150987 Jul 12 14:40:29.810432 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 95/191] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:29 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:29.811170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-d8ab5121-9428-4e58-9768-db81b11c5208 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:29.811170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-d8ab5121-9428-4e58-9768-db81b11c5208 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:29.811621 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-8fbe7986-ecaf-4d90-a79f-66f53c902adb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:29.811621 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-8fbe7986-ecaf-4d90-a79f-66f53c902adb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:29.811790 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d8ab5121-9428-4e58-9768-db81b11c5208 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:29.811790 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d8ab5121-9428-4e58-9768-db81b11c5208 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:29.811790 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d8ab5121-9428-4e58-9768-db81b11c5208 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:29.811790 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d8ab5121-9428-4e58-9768-db81b11c5208 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:29.812140 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8fbe7986-ecaf-4d90-a79f-66f53c902adb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:29.812140 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8fbe7986-ecaf-4d90-a79f-66f53c902adb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:29.812140 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8fbe7986-ecaf-4d90-a79f-66f53c902adb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:29.812140 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8fbe7986-ecaf-4d90-a79f-66f53c902adb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:29.855948 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-d8ab5121-9428-4e58-9768-db81b11c5208 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:29.863433 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-8fbe7986-ecaf-4d90-a79f-66f53c902adb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:29.864033 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-d8ab5121-9428-4e58-9768-db81b11c5208 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.211195 Jul 12 14:40:29.864709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 97/192] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:29 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:29.871758 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-8fbe7986-ecaf-4d90-a79f-66f53c902adb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:29.873659 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-8fbe7986-ecaf-4d90-a79f-66f53c902adb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:29.874855 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-8fbe7986-ecaf-4d90-a79f-66f53c902adb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.215757 Jul 12 14:40:29.875485 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 96/193] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:29 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:40:30.479848 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-452b624f-f72d-46f1-a5de-c303b8a6cf76 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:30.480381 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-452b624f-f72d-46f1-a5de-c303b8a6cf76 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:30.486523 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-452b624f-f72d-46f1-a5de-c303b8a6cf76 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:30.486967 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-452b624f-f72d-46f1-a5de-c303b8a6cf76 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:30.487711 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-452b624f-f72d-46f1-a5de-c303b8a6cf76 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:30.488137 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-452b624f-f72d-46f1-a5de-c303b8a6cf76 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:30.615348 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-452b624f-f72d-46f1-a5de-c303b8a6cf76 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:30.623450 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-452b624f-f72d-46f1-a5de-c303b8a6cf76 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.147473 Jul 12 14:40:30.624002 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 98/194] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:30 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:30.880431 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c366a90e-0346-4e42-9ce0-f14e0f17e8c1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:30.881206 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-c366a90e-0346-4e42-9ce0-f14e0f17e8c1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:30.887333 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c366a90e-0346-4e42-9ce0-f14e0f17e8c1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:30.897227 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c366a90e-0346-4e42-9ce0-f14e0f17e8c1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:30.897227 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c366a90e-0346-4e42-9ce0-f14e0f17e8c1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:30.897227 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c366a90e-0346-4e42-9ce0-f14e0f17e8c1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:30.897612 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-585a6773-9459-458f-8e69-3137375f005c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:30.897612 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-585a6773-9459-458f-8e69-3137375f005c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:30.902585 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-585a6773-9459-458f-8e69-3137375f005c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:30.903037 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-585a6773-9459-458f-8e69-3137375f005c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:30.903812 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-585a6773-9459-458f-8e69-3137375f005c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:30.904247 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-585a6773-9459-458f-8e69-3137375f005c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:31.133866 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c366a90e-0346-4e42-9ce0-f14e0f17e8c1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:31.137817 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-585a6773-9459-458f-8e69-3137375f005c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:31.141796 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-c366a90e-0346-4e42-9ce0-f14e0f17e8c1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1322 microversion: 2.1 time: 0.265169 Jul 12 14:40:31.142455 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 97/195] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:30 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:31.145907 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-585a6773-9459-458f-8e69-3137375f005c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:31.147491 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-585a6773-9459-458f-8e69-3137375f005c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:31.148580 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-585a6773-9459-458f-8e69-3137375f005c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.256590 Jul 12 14:40:31.149124 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 99/196] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:30 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:40:31.640474 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-bf416030-31c0-4fbf-8ece-ab5a965f6c41 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:31.641062 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-bf416030-31c0-4fbf-8ece-ab5a965f6c41 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:31.647028 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bf416030-31c0-4fbf-8ece-ab5a965f6c41 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:31.647465 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bf416030-31c0-4fbf-8ece-ab5a965f6c41 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:31.648211 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bf416030-31c0-4fbf-8ece-ab5a965f6c41 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:31.648688 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bf416030-31c0-4fbf-8ece-ab5a965f6c41 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:31.796617 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-bf416030-31c0-4fbf-8ece-ab5a965f6c41 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:31.820198 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-bf416030-31c0-4fbf-8ece-ab5a965f6c41 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.184066 Jul 12 14:40:31.821045 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 98/197] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:31 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:32.041456 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-d43263c6-1e65-4612-9417-7148cd7b9d71 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c00f8820-6903-42d8-8458-4fb8f3b4b28c"}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:40:32.042522 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-d43263c6-1e65-4612-9417-7148cd7b9d71 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:32.049859 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d43263c6-1e65-4612-9417-7148cd7b9d71 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:32.050391 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d43263c6-1e65-4612-9417-7148cd7b9d71 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:32.051237 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d43263c6-1e65-4612-9417-7148cd7b9d71 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:32.051763 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d43263c6-1e65-4612-9417-7148cd7b9d71 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:32.163405 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d9dd9ac7-e4ae-49c3-9ff7-17c7cf743269 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:32.165937 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-d9dd9ac7-e4ae-49c3-9ff7-17c7cf743269 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:32.173770 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d9dd9ac7-e4ae-49c3-9ff7-17c7cf743269 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:32.174440 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d9dd9ac7-e4ae-49c3-9ff7-17c7cf743269 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:32.175649 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d9dd9ac7-e4ae-49c3-9ff7-17c7cf743269 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:32.176300 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d9dd9ac7-e4ae-49c3-9ff7-17c7cf743269 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:32.324688 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d9dd9ac7-e4ae-49c3-9ff7-17c7cf743269 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:32.334069 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-d9dd9ac7-e4ae-49c3-9ff7-17c7cf743269 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1515 microversion: 2.1 time: 0.177893 Jul 12 14:40:32.345403 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 99/198] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:32 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:32.351693 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-3eb67a04-534b-4bd1-a033-fca8038657b2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:32.357796 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-3eb67a04-534b-4bd1-a033-fca8038657b2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:32.358967 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3eb67a04-534b-4bd1-a033-fca8038657b2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:32.359590 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3eb67a04-534b-4bd1-a033-fca8038657b2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:32.360341 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3eb67a04-534b-4bd1-a033-fca8038657b2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:32.360794 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3eb67a04-534b-4bd1-a033-fca8038657b2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:32.500929 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-3eb67a04-534b-4bd1-a033-fca8038657b2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:32.508888 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-3eb67a04-534b-4bd1-a033-fca8038657b2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:32.510403 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-3eb67a04-534b-4bd1-a033-fca8038657b2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:32.511502 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-3eb67a04-534b-4bd1-a033-fca8038657b2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.164457 Jul 12 14:40:32.512168 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 100/199] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:32 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:40:32.517760 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-258b5dc1-a5ad-4af4-ab27-fee1d7727383 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:40:32.518803 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-258b5dc1-a5ad-4af4-ab27-fee1d7727383 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:32.533876 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-258b5dc1-a5ad-4af4-ab27-fee1d7727383 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:32.533876 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-258b5dc1-a5ad-4af4-ab27-fee1d7727383 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:32.533876 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-258b5dc1-a5ad-4af4-ab27-fee1d7727383 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:32.533876 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-258b5dc1-a5ad-4af4-ab27-fee1d7727383 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:32.588573 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.objects.instance [None req-258b5dc1-a5ad-4af4-ab27-fee1d7727383 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lazy-loading 'flavor' on Instance uuid 4c32aaf0-6aa0-4298-aa4b-a285af8940c7 {{(pid=129981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:40:32.964011 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-258b5dc1-a5ad-4af4-ab27-fee1d7727383 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "POST /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7/action" status: 200 len: 32 microversion: 2.1 time: 0.450166 Jul 12 14:40:32.964633 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 101/200] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Jul 12 14:40:32 2022] POST /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7/action => generated 32 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 14:40:32.970789 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-b0c35f10-b608-4919-b972-7b87d46b0fa1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:32.970789 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-b0c35f10-b608-4919-b972-7b87d46b0fa1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:32.976567 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b0c35f10-b608-4919-b972-7b87d46b0fa1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:32.976994 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b0c35f10-b608-4919-b972-7b87d46b0fa1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:32.977783 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b0c35f10-b608-4919-b972-7b87d46b0fa1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:32.978254 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b0c35f10-b608-4919-b972-7b87d46b0fa1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:33.105255 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-b0c35f10-b608-4919-b972-7b87d46b0fa1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:33.112907 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-b0c35f10-b608-4919-b972-7b87d46b0fa1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.147063 Jul 12 14:40:33.113499 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 102/201] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:32 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:33.117839 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-6e6b8e25-851d-48c3-9b7e-27c6fb9cab01 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:33.118429 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-6e6b8e25-851d-48c3-9b7e-27c6fb9cab01 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:33.124908 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6e6b8e25-851d-48c3-9b7e-27c6fb9cab01 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:33.125272 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6e6b8e25-851d-48c3-9b7e-27c6fb9cab01 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:33.126021 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6e6b8e25-851d-48c3-9b7e-27c6fb9cab01 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:33.126446 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6e6b8e25-851d-48c3-9b7e-27c6fb9cab01 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:33.254389 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-6e6b8e25-851d-48c3-9b7e-27c6fb9cab01 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:33.261945 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-6e6b8e25-851d-48c3-9b7e-27c6fb9cab01 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1521 microversion: 2.1 time: 0.147534 Jul 12 14:40:33.262893 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 103/202] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:33 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:33.533901 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d1e4905b-1148-428b-b3cd-41e5c289335d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:33.534495 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-d1e4905b-1148-428b-b3cd-41e5c289335d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:33.540355 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d1e4905b-1148-428b-b3cd-41e5c289335d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:33.540792 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d1e4905b-1148-428b-b3cd-41e5c289335d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:33.541584 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d1e4905b-1148-428b-b3cd-41e5c289335d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:33.542009 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d1e4905b-1148-428b-b3cd-41e5c289335d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:33.669958 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d1e4905b-1148-428b-b3cd-41e5c289335d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:33.673487 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:33.678453 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d1e4905b-1148-428b-b3cd-41e5c289335d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:33.679914 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d1e4905b-1148-428b-b3cd-41e5c289335d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:33.680995 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-d1e4905b-1148-428b-b3cd-41e5c289335d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.150934 Jul 12 14:40:33.681576 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 104/203] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:33 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:40:34.129266 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-8e58ebbf-3af5-4a38-87f2-1826028b7120 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:34.129881 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-8e58ebbf-3af5-4a38-87f2-1826028b7120 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:34.136662 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8e58ebbf-3af5-4a38-87f2-1826028b7120 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:34.137114 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8e58ebbf-3af5-4a38-87f2-1826028b7120 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:34.138423 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8e58ebbf-3af5-4a38-87f2-1826028b7120 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:34.138873 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8e58ebbf-3af5-4a38-87f2-1826028b7120 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:34.276893 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-8e58ebbf-3af5-4a38-87f2-1826028b7120 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:34.284930 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-8e58ebbf-3af5-4a38-87f2-1826028b7120 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.159518 Jul 12 14:40:34.285520 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 105/204] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:34 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:34.289793 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-f8b375c6-e6c6-4a45-82ec-02d3ebe0a514 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:34.290386 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-f8b375c6-e6c6-4a45-82ec-02d3ebe0a514 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:34.295910 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f8b375c6-e6c6-4a45-82ec-02d3ebe0a514 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:34.296353 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f8b375c6-e6c6-4a45-82ec-02d3ebe0a514 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:34.297101 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f8b375c6-e6c6-4a45-82ec-02d3ebe0a514 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:34.297565 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f8b375c6-e6c6-4a45-82ec-02d3ebe0a514 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:34.424997 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-f8b375c6-e6c6-4a45-82ec-02d3ebe0a514 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:34.432534 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-f8b375c6-e6c6-4a45-82ec-02d3ebe0a514 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1521 microversion: 2.1 time: 0.146057 Jul 12 14:40:34.438964 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 106/205] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:34 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:34.698677 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-4dc2d463-3581-4ebf-9488-0ec2bffa8619 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:34.699268 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-4dc2d463-3581-4ebf-9488-0ec2bffa8619 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:34.705405 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4dc2d463-3581-4ebf-9488-0ec2bffa8619 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:34.705847 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4dc2d463-3581-4ebf-9488-0ec2bffa8619 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:34.706588 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4dc2d463-3581-4ebf-9488-0ec2bffa8619 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:34.707011 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4dc2d463-3581-4ebf-9488-0ec2bffa8619 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:34.833620 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-4dc2d463-3581-4ebf-9488-0ec2bffa8619 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:34.842228 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-4dc2d463-3581-4ebf-9488-0ec2bffa8619 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:34.843731 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-4dc2d463-3581-4ebf-9488-0ec2bffa8619 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:34.844997 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-4dc2d463-3581-4ebf-9488-0ec2bffa8619 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.150151 Jul 12 14:40:34.845611 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 107/206] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:34 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:40:35.301547 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e64455b9-345a-442d-9365-fc93fd060c6f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:35.302158 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-e64455b9-345a-442d-9365-fc93fd060c6f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:35.308198 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e64455b9-345a-442d-9365-fc93fd060c6f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:35.308645 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e64455b9-345a-442d-9365-fc93fd060c6f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:35.309451 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e64455b9-345a-442d-9365-fc93fd060c6f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:35.309911 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e64455b9-345a-442d-9365-fc93fd060c6f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:35.434642 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e64455b9-345a-442d-9365-fc93fd060c6f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:35.442176 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-e64455b9-345a-442d-9365-fc93fd060c6f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.144425 Jul 12 14:40:35.442752 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 108/207] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:35 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:35.454084 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-7fbfa9c4-09d4-4d70-8a30-b73cff28b520 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:35.454625 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-7fbfa9c4-09d4-4d70-8a30-b73cff28b520 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:35.460447 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7fbfa9c4-09d4-4d70-8a30-b73cff28b520 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:35.460886 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7fbfa9c4-09d4-4d70-8a30-b73cff28b520 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:35.461667 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7fbfa9c4-09d4-4d70-8a30-b73cff28b520 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:35.462097 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7fbfa9c4-09d4-4d70-8a30-b73cff28b520 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:35.589244 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7fbfa9c4-09d4-4d70-8a30-b73cff28b520 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:35.597199 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-7fbfa9c4-09d4-4d70-8a30-b73cff28b520 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1521 microversion: 2.1 time: 0.147233 Jul 12 14:40:35.597761 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 109/208] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:35 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:35.862869 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-06f2d5a2-d699-4872-b9d6-557fa70ff05a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:35.863468 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-06f2d5a2-d699-4872-b9d6-557fa70ff05a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:35.869543 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-06f2d5a2-d699-4872-b9d6-557fa70ff05a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:35.869985 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-06f2d5a2-d699-4872-b9d6-557fa70ff05a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:35.870736 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-06f2d5a2-d699-4872-b9d6-557fa70ff05a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:35.871161 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-06f2d5a2-d699-4872-b9d6-557fa70ff05a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:36.017914 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-06f2d5a2-d699-4872-b9d6-557fa70ff05a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:36.026025 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-06f2d5a2-d699-4872-b9d6-557fa70ff05a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:36.027521 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-06f2d5a2-d699-4872-b9d6-557fa70ff05a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:36.028606 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-06f2d5a2-d699-4872-b9d6-557fa70ff05a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.169568 Jul 12 14:40:36.029218 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 110/209] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:35 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:40:36.458869 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-74d29c3e-9267-4de3-b534-696a33660c08 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:36.459471 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-74d29c3e-9267-4de3-b534-696a33660c08 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:36.465954 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-74d29c3e-9267-4de3-b534-696a33660c08 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:36.466402 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-74d29c3e-9267-4de3-b534-696a33660c08 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:36.467148 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-74d29c3e-9267-4de3-b534-696a33660c08 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:36.467570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-74d29c3e-9267-4de3-b534-696a33660c08 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:36.609661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-74d29c3e-9267-4de3-b534-696a33660c08 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:36.614117 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-74d29c3e-9267-4de3-b534-696a33660c08 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1362 microversion: 2.1 time: 0.159076 Jul 12 14:40:36.614683 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 111/210] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:36 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:36.619395 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-1e1c3e6c-da6e-4cfa-82e9-57bf13fdbc73 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:36.619996 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-1e1c3e6c-da6e-4cfa-82e9-57bf13fdbc73 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:36.626605 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1e1c3e6c-da6e-4cfa-82e9-57bf13fdbc73 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:36.627050 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1e1c3e6c-da6e-4cfa-82e9-57bf13fdbc73 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:36.627809 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1e1c3e6c-da6e-4cfa-82e9-57bf13fdbc73 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:36.628239 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1e1c3e6c-da6e-4cfa-82e9-57bf13fdbc73 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:36.769874 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-1e1c3e6c-da6e-4cfa-82e9-57bf13fdbc73 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:36.777448 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-1e1c3e6c-da6e-4cfa-82e9-57bf13fdbc73 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1521 microversion: 2.1 time: 0.161474 Jul 12 14:40:36.778075 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 112/211] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:36 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:37.047266 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-4247481f-956a-4bde-89aa-a842bef0e1dc tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:37.047874 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-4247481f-956a-4bde-89aa-a842bef0e1dc tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:37.054870 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4247481f-956a-4bde-89aa-a842bef0e1dc tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:37.055318 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4247481f-956a-4bde-89aa-a842bef0e1dc tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:37.056721 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4247481f-956a-4bde-89aa-a842bef0e1dc tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:37.057350 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4247481f-956a-4bde-89aa-a842bef0e1dc tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:37.227117 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-4247481f-956a-4bde-89aa-a842bef0e1dc tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:37.235500 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-4247481f-956a-4bde-89aa-a842bef0e1dc tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:37.237096 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-4247481f-956a-4bde-89aa-a842bef0e1dc tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:37.238556 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-4247481f-956a-4bde-89aa-a842bef0e1dc tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.195912 Jul 12 14:40:37.239117 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 113/212] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:37 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:40:37.631656 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-72bbf3a6-fcb7-4690-86bc-53a56c2cae8e tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:37.632406 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-72bbf3a6-fcb7-4690-86bc-53a56c2cae8e tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:37.640429 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-72bbf3a6-fcb7-4690-86bc-53a56c2cae8e tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:37.640429 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-72bbf3a6-fcb7-4690-86bc-53a56c2cae8e tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:37.640429 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-72bbf3a6-fcb7-4690-86bc-53a56c2cae8e tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:37.640800 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-72bbf3a6-fcb7-4690-86bc-53a56c2cae8e tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:37.740077 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-d43263c6-1e65-4612-9417-7148cd7b9d71 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "POST /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.702504 Jul 12 14:40:37.741330 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 100/213] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Jul 12 14:40:32 2022] POST /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1/os-volume_attachments => generated 194 bytes in 5705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:40:37.791783 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-72bbf3a6-fcb7-4690-86bc-53a56c2cae8e tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:37.794374 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-f43d8184-e482-4204-9352-b54296061769 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:37.795308 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-f43d8184-e482-4204-9352-b54296061769 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:37.801125 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-72bbf3a6-fcb7-4690-86bc-53a56c2cae8e tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1549 microversion: 2.1 time: 0.173081 Jul 12 14:40:37.802221 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 114/214] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:37 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:37.803060 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f43d8184-e482-4204-9352-b54296061769 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:37.803514 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f43d8184-e482-4204-9352-b54296061769 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:37.804715 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f43d8184-e482-4204-9352-b54296061769 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:37.805349 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f43d8184-e482-4204-9352-b54296061769 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:37.818918 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-4ad4d3ba-5135-4dba-85db-f7ae275131d3 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:37.820098 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-4ad4d3ba-5135-4dba-85db-f7ae275131d3 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:37.827477 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4ad4d3ba-5135-4dba-85db-f7ae275131d3 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:37.828348 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4ad4d3ba-5135-4dba-85db-f7ae275131d3 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:37.829615 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4ad4d3ba-5135-4dba-85db-f7ae275131d3 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:37.830477 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4ad4d3ba-5135-4dba-85db-f7ae275131d3 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:37.992402 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-4ad4d3ba-5135-4dba-85db-f7ae275131d3 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.177716 Jul 12 14:40:37.993263 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 115/215] 10.222.0.30 () {58 vars in 1274 bytes} [Tue Jul 12 14:40:37 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560/os-interface => generated 285 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:40:38.117287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-f43d8184-e482-4204-9352-b54296061769 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:38.126490 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-f43d8184-e482-4204-9352-b54296061769 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1521 microversion: 2.1 time: 0.336418 Jul 12 14:40:38.127868 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 101/216] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:37 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:38.257100 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-419c9dab-d28e-4dfe-bb86-02503c706a8b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:38.257967 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-419c9dab-d28e-4dfe-bb86-02503c706a8b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:38.266432 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-419c9dab-d28e-4dfe-bb86-02503c706a8b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:38.267165 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-419c9dab-d28e-4dfe-bb86-02503c706a8b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:38.267938 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-419c9dab-d28e-4dfe-bb86-02503c706a8b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:38.268363 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-419c9dab-d28e-4dfe-bb86-02503c706a8b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:38.563399 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-419c9dab-d28e-4dfe-bb86-02503c706a8b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:38.571403 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-419c9dab-d28e-4dfe-bb86-02503c706a8b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:38.572937 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-419c9dab-d28e-4dfe-bb86-02503c706a8b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:38.574054 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-419c9dab-d28e-4dfe-bb86-02503c706a8b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.320870 Jul 12 14:40:38.575847 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 116/217] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:38 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:40:39.145664 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-c3a539d5-30e6-489a-8e3e-765945c4b4c7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:39.146837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-c3a539d5-30e6-489a-8e3e-765945c4b4c7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:39.154114 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c3a539d5-30e6-489a-8e3e-765945c4b4c7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:39.154566 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c3a539d5-30e6-489a-8e3e-765945c4b4c7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:39.155345 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c3a539d5-30e6-489a-8e3e-765945c4b4c7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:39.155785 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c3a539d5-30e6-489a-8e3e-765945c4b4c7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:39.431659 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-c3a539d5-30e6-489a-8e3e-765945c4b4c7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:39.447517 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-c3a539d5-30e6-489a-8e3e-765945c4b4c7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1521 microversion: 2.1 time: 0.305626 Jul 12 14:40:39.448158 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 102/218] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:39 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:39.594306 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-edad2282-57c0-46fe-b045-d0ca33c52dd2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:39.595888 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-edad2282-57c0-46fe-b045-d0ca33c52dd2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:39.602665 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-edad2282-57c0-46fe-b045-d0ca33c52dd2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:39.603560 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-edad2282-57c0-46fe-b045-d0ca33c52dd2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:39.604645 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-edad2282-57c0-46fe-b045-d0ca33c52dd2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:39.605533 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-edad2282-57c0-46fe-b045-d0ca33c52dd2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:40.044404 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-edad2282-57c0-46fe-b045-d0ca33c52dd2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:40.057708 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-edad2282-57c0-46fe-b045-d0ca33c52dd2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:40.061246 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-edad2282-57c0-46fe-b045-d0ca33c52dd2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:40.062806 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-edad2282-57c0-46fe-b045-d0ca33c52dd2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1407 microversion: 2.20 time: 0.474573 Jul 12 14:40:40.064405 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 117/219] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:39 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1407 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:40:40.282606 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-db615c80-5e47-4e00-8470-edfec45e325e req-2e1b7745-d9bc-4f93-a02f-d4248adb5c9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8f59b92-aa7f-496d-a19c-9035a4948560", "tag": "68fcc4b4-c1bb-4548-816a-03ac719e76aa"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:40:40.282606 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-db615c80-5e47-4e00-8470-edfec45e325e req-2e1b7745-d9bc-4f93-a02f-d4248adb5c9d service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:40.282606 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-db615c80-5e47-4e00-8470-edfec45e325e req-2e1b7745-d9bc-4f93-a02f-d4248adb5c9d service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:40.299592 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-db615c80-5e47-4e00-8470-edfec45e325e req-2e1b7745-d9bc-4f93-a02f-d4248adb5c9d service nova] Creating event network-changed:68fcc4b4-c1bb-4548-816a-03ac719e76aa for instance b8f59b92-aa7f-496d-a19c-9035a4948560 on hv-cinder-82002 Jul 12 14:40:40.314145 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-db615c80-5e47-4e00-8470-edfec45e325e req-2e1b7745-d9bc-4f93-a02f-d4248adb5c9d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061289 Jul 12 14:40:40.322361 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 103/220] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:40:40.464549 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-5479f6f2-a928-4e26-9b05-d3e7f6b8ccf4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:40.466243 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-5479f6f2-a928-4e26-9b05-d3e7f6b8ccf4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:40.475056 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5479f6f2-a928-4e26-9b05-d3e7f6b8ccf4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:40.475762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5479f6f2-a928-4e26-9b05-d3e7f6b8ccf4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:40.476757 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5479f6f2-a928-4e26-9b05-d3e7f6b8ccf4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:40.477573 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5479f6f2-a928-4e26-9b05-d3e7f6b8ccf4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:40.621142 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-5479f6f2-a928-4e26-9b05-d3e7f6b8ccf4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:40.632428 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-5479f6f2-a928-4e26-9b05-d3e7f6b8ccf4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1521 microversion: 2.1 time: 0.171985 Jul 12 14:40:40.635714 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 118/221] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:40 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:41.082821 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-33d070bc-dd84-4df5-b04f-dda09b700be3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:41.083682 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-33d070bc-dd84-4df5-b04f-dda09b700be3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:41.095062 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-33d070bc-dd84-4df5-b04f-dda09b700be3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:41.096679 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-33d070bc-dd84-4df5-b04f-dda09b700be3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:41.097803 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-33d070bc-dd84-4df5-b04f-dda09b700be3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:41.100359 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-33d070bc-dd84-4df5-b04f-dda09b700be3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:41.637649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-33d070bc-dd84-4df5-b04f-dda09b700be3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:41.658072 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-56c18f31-56a4-4ffd-83f0-e43e94d7953c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:41.658072 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-56c18f31-56a4-4ffd-83f0-e43e94d7953c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:41.658621 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-33d070bc-dd84-4df5-b04f-dda09b700be3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:41.658621 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-33d070bc-dd84-4df5-b04f-dda09b700be3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:41.660214 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-33d070bc-dd84-4df5-b04f-dda09b700be3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1599 microversion: 2.20 time: 0.582144 Jul 12 14:40:41.661647 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-56c18f31-56a4-4ffd-83f0-e43e94d7953c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:41.661884 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 104/222] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:40:41 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1599 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:40:41.662520 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-56c18f31-56a4-4ffd-83f0-e43e94d7953c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:41.663406 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-56c18f31-56a4-4ffd-83f0-e43e94d7953c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:41.663945 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-56c18f31-56a4-4ffd-83f0-e43e94d7953c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:41.681645 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-a1850a6b-37a8-4a6b-9424-45b3a3843014 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:41.682385 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-a1850a6b-37a8-4a6b-9424-45b3a3843014 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:41.689873 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a1850a6b-37a8-4a6b-9424-45b3a3843014 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:41.690560 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a1850a6b-37a8-4a6b-9424-45b3a3843014 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:41.691517 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a1850a6b-37a8-4a6b-9424-45b3a3843014 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:41.692106 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a1850a6b-37a8-4a6b-9424-45b3a3843014 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:41.845924 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-a1850a6b-37a8-4a6b-9424-45b3a3843014 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.169399 Jul 12 14:40:41.852539 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 105/223] 10.222.0.30 () {60 vars in 1315 bytes} [Tue Jul 12 14:40:41 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a/os-interface => generated 285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:40:41.919842 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-56c18f31-56a4-4ffd-83f0-e43e94d7953c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:41.942485 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-56c18f31-56a4-4ffd-83f0-e43e94d7953c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1521 microversion: 2.1 time: 0.295300 Jul 12 14:40:41.945025 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 119/224] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:41 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:42.963837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-171f8f5c-544e-4a5e-8a54-7779ad87c447 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:42.965148 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-171f8f5c-544e-4a5e-8a54-7779ad87c447 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:42.973300 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-171f8f5c-544e-4a5e-8a54-7779ad87c447 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:42.974058 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-171f8f5c-544e-4a5e-8a54-7779ad87c447 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:42.975317 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-171f8f5c-544e-4a5e-8a54-7779ad87c447 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:42.978681 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-171f8f5c-544e-4a5e-8a54-7779ad87c447 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:43.188378 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-171f8f5c-544e-4a5e-8a54-7779ad87c447 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:43.196270 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-171f8f5c-544e-4a5e-8a54-7779ad87c447 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1521 microversion: 2.1 time: 0.238299 Jul 12 14:40:43.196850 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 106/225] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:42 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:43.629759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-5db187ff-bc2b-45e5-bcac-6a2d114aac8e req-5ce4fceb-8081-4905-abb5-51fc23032328 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26eeea2d-c1c2-46a7-b727-269cf6dce92a", "tag": "f0edff70-5e51-412d-b474-2a70b09725f5"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:40:43.640411 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-5db187ff-bc2b-45e5-bcac-6a2d114aac8e req-5ce4fceb-8081-4905-abb5-51fc23032328 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:43.640965 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-5db187ff-bc2b-45e5-bcac-6a2d114aac8e req-5ce4fceb-8081-4905-abb5-51fc23032328 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:43.654893 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-5db187ff-bc2b-45e5-bcac-6a2d114aac8e req-5ce4fceb-8081-4905-abb5-51fc23032328 service nova] Creating event network-changed:f0edff70-5e51-412d-b474-2a70b09725f5 for instance 26eeea2d-c1c2-46a7-b727-269cf6dce92a on hv-cinder-82002 Jul 12 14:40:43.660397 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-5db187ff-bc2b-45e5-bcac-6a2d114aac8e req-5ce4fceb-8081-4905-abb5-51fc23032328 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034452 Jul 12 14:40:43.662542 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 120/226] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:40:44.213264 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-6236ef39-637d-4773-abfc-d2f030cd6e77 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:44.213972 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-6236ef39-637d-4773-abfc-d2f030cd6e77 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:44.226002 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6236ef39-637d-4773-abfc-d2f030cd6e77 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:44.226002 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6236ef39-637d-4773-abfc-d2f030cd6e77 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:44.227844 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6236ef39-637d-4773-abfc-d2f030cd6e77 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:44.228450 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6236ef39-637d-4773-abfc-d2f030cd6e77 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:44.637491 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-6236ef39-637d-4773-abfc-d2f030cd6e77 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:44.649100 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-6236ef39-637d-4773-abfc-d2f030cd6e77 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1521 microversion: 2.1 time: 0.439726 Jul 12 14:40:44.651418 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 107/227] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:44 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1521 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:45.668324 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c6bd60f0-2131-4866-adb2-c3106184f5e1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:45.669011 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-c6bd60f0-2131-4866-adb2-c3106184f5e1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:45.675449 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c6bd60f0-2131-4866-adb2-c3106184f5e1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:45.675874 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c6bd60f0-2131-4866-adb2-c3106184f5e1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:45.676808 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c6bd60f0-2131-4866-adb2-c3106184f5e1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:45.677265 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c6bd60f0-2131-4866-adb2-c3106184f5e1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:45.827222 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c6bd60f0-2131-4866-adb2-c3106184f5e1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:45.834834 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-c6bd60f0-2131-4866-adb2-c3106184f5e1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1521 microversion: 2.1 time: 0.170725 Jul 12 14:40:45.835386 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 121/228] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:45 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:46.852323 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-16ef419d-a103-43e5-b3a1-d07b144e0b7f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:46.853016 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-16ef419d-a103-43e5-b3a1-d07b144e0b7f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:46.860268 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-16ef419d-a103-43e5-b3a1-d07b144e0b7f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:46.860715 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-16ef419d-a103-43e5-b3a1-d07b144e0b7f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:46.861533 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-16ef419d-a103-43e5-b3a1-d07b144e0b7f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:46.861963 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-16ef419d-a103-43e5-b3a1-d07b144e0b7f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:46.998098 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-16ef419d-a103-43e5-b3a1-d07b144e0b7f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:47.002308 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:47.007791 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-16ef419d-a103-43e5-b3a1-d07b144e0b7f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1521 microversion: 2.1 time: 0.159987 Jul 12 14:40:47.008659 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 108/229] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:46 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:48.025836 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-83f25820-aa05-4155-b8f8-a202852c48c8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:48.027117 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-83f25820-aa05-4155-b8f8-a202852c48c8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:48.033424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-83f25820-aa05-4155-b8f8-a202852c48c8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:48.033868 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-83f25820-aa05-4155-b8f8-a202852c48c8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:48.034632 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-83f25820-aa05-4155-b8f8-a202852c48c8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:48.035091 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-83f25820-aa05-4155-b8f8-a202852c48c8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:48.057530 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=100 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:48.193951 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-83f25820-aa05-4155-b8f8-a202852c48c8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:48.202283 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-83f25820-aa05-4155-b8f8-a202852c48c8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1521 microversion: 2.1 time: 0.180592 Jul 12 14:40:48.202891 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 122/230] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:48 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:49.243752 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-be86e7f3-3222-4c13-a769-4ebc6121cbc3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:49.248677 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-be86e7f3-3222-4c13-a769-4ebc6121cbc3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:49.260576 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-be86e7f3-3222-4c13-a769-4ebc6121cbc3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:49.261021 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-be86e7f3-3222-4c13-a769-4ebc6121cbc3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:49.261872 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-be86e7f3-3222-4c13-a769-4ebc6121cbc3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:49.262303 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-be86e7f3-3222-4c13-a769-4ebc6121cbc3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:49.446779 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-be86e7f3-3222-4c13-a769-4ebc6121cbc3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:49.468409 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-be86e7f3-3222-4c13-a769-4ebc6121cbc3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1521 microversion: 2.1 time: 0.239093 Jul 12 14:40:49.478408 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 109/231] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:49 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:50.496274 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d70b5a57-7c33-4ab9-8fab-8a8cbf2b56be tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:50.497180 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-d70b5a57-7c33-4ab9-8fab-8a8cbf2b56be tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:50.512345 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d70b5a57-7c33-4ab9-8fab-8a8cbf2b56be tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:50.512918 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d70b5a57-7c33-4ab9-8fab-8a8cbf2b56be tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:50.513620 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d70b5a57-7c33-4ab9-8fab-8a8cbf2b56be tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:50.514064 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d70b5a57-7c33-4ab9-8fab-8a8cbf2b56be tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:50.559892 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-6e7547e4-ae73-43d9-b9bd-648234805a70 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:50.560381 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-6e7547e4-ae73-43d9-b9bd-648234805a70 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:50.580688 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_api:SELECT=60 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:50.590550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6e7547e4-ae73-43d9-b9bd-648234805a70 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:50.591052 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6e7547e4-ae73-43d9-b9bd-648234805a70 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:50.592078 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6e7547e4-ae73-43d9-b9bd-648234805a70 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:50.594868 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6e7547e4-ae73-43d9-b9bd-648234805a70 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:50.644129 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-6e7547e4-ae73-43d9-b9bd-648234805a70 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Going to try to terminate instance {{(pid=129980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:40:50.844700 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d70b5a57-7c33-4ab9-8fab-8a8cbf2b56be tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:50.864149 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-d70b5a57-7c33-4ab9-8fab-8a8cbf2b56be tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1521 microversion: 2.1 time: 0.371703 Jul 12 14:40:50.865268 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 123/232] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:50 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:50.982577 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-6e7547e4-ae73-43d9-b9bd-648234805a70 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 204 len: 0 microversion: 2.1 time: 0.426125 Jul 12 14:40:50.986192 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 110/233] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Jul 12 14:40:50 2022] DELETE /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:40:50.995266 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-aa23c702-5771-4459-b2fe-f8729bfd8bdd tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:50.996427 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-aa23c702-5771-4459-b2fe-f8729bfd8bdd tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:51.007051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-aa23c702-5771-4459-b2fe-f8729bfd8bdd tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:51.007523 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-aa23c702-5771-4459-b2fe-f8729bfd8bdd tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:51.008284 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-aa23c702-5771-4459-b2fe-f8729bfd8bdd tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:51.008720 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-aa23c702-5771-4459-b2fe-f8729bfd8bdd tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:51.280791 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-aa23c702-5771-4459-b2fe-f8729bfd8bdd tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:51.300112 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-aa23c702-5771-4459-b2fe-f8729bfd8bdd tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1553 microversion: 2.1 time: 0.312003 Jul 12 14:40:51.300720 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 124/234] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:50 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1553 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:51.883491 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-3850cc67-bf82-4378-8c2d-8b138345c7bf tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:51.884176 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-3850cc67-bf82-4378-8c2d-8b138345c7bf tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:51.892416 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3850cc67-bf82-4378-8c2d-8b138345c7bf tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:51.893184 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3850cc67-bf82-4378-8c2d-8b138345c7bf tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:51.894244 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3850cc67-bf82-4378-8c2d-8b138345c7bf tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:51.894893 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3850cc67-bf82-4378-8c2d-8b138345c7bf tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:52.036276 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-3850cc67-bf82-4378-8c2d-8b138345c7bf tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:52.044204 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-3850cc67-bf82-4378-8c2d-8b138345c7bf tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1521 microversion: 2.1 time: 0.165296 Jul 12 14:40:52.044760 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 111/235] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:51 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:52.320331 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-777fa0f5-4fdc-444e-97d2-4c914112518d tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:52.321664 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-777fa0f5-4fdc-444e-97d2-4c914112518d tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:52.328608 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-777fa0f5-4fdc-444e-97d2-4c914112518d tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:52.333520 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-777fa0f5-4fdc-444e-97d2-4c914112518d tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:52.334459 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-777fa0f5-4fdc-444e-97d2-4c914112518d tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:52.334961 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-777fa0f5-4fdc-444e-97d2-4c914112518d tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:52.522133 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-777fa0f5-4fdc-444e-97d2-4c914112518d tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:52.532933 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-777fa0f5-4fdc-444e-97d2-4c914112518d tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1553 microversion: 2.1 time: 0.217666 Jul 12 14:40:52.533595 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 125/236] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:52 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1553 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:53.062660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-97fa03f0-eb0f-4d5a-9b70-bd17a1dde3b9 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:53.063497 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-97fa03f0-eb0f-4d5a-9b70-bd17a1dde3b9 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:53.071912 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-97fa03f0-eb0f-4d5a-9b70-bd17a1dde3b9 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:53.072633 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-97fa03f0-eb0f-4d5a-9b70-bd17a1dde3b9 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:53.074695 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-97fa03f0-eb0f-4d5a-9b70-bd17a1dde3b9 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:53.075538 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-97fa03f0-eb0f-4d5a-9b70-bd17a1dde3b9 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:53.273556 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-97fa03f0-eb0f-4d5a-9b70-bd17a1dde3b9 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:53.281502 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-97fa03f0-eb0f-4d5a-9b70-bd17a1dde3b9 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1521 microversion: 2.1 time: 0.224089 Jul 12 14:40:53.282294 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 112/237] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:53 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:53.560007 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-bdcb248c-4d91-4e01-a746-ba3f64ce52d5 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:53.560007 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-bdcb248c-4d91-4e01-a746-ba3f64ce52d5 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:53.560504 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bdcb248c-4d91-4e01-a746-ba3f64ce52d5 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:53.560942 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bdcb248c-4d91-4e01-a746-ba3f64ce52d5 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:53.562094 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bdcb248c-4d91-4e01-a746-ba3f64ce52d5 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:53.562742 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bdcb248c-4d91-4e01-a746-ba3f64ce52d5 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:53.751136 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-bdcb248c-4d91-4e01-a746-ba3f64ce52d5 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:53.761359 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-bdcb248c-4d91-4e01-a746-ba3f64ce52d5 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1553 microversion: 2.1 time: 0.214486 Jul 12 14:40:53.762799 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 126/238] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:53 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1553 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:54.298924 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-48269d5d-2ad4-4964-8070-f90bb952e2fa tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:54.299711 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-48269d5d-2ad4-4964-8070-f90bb952e2fa tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:54.313739 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-48269d5d-2ad4-4964-8070-f90bb952e2fa tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:54.314188 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-48269d5d-2ad4-4964-8070-f90bb952e2fa tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:54.314962 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-48269d5d-2ad4-4964-8070-f90bb952e2fa tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:54.315577 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-48269d5d-2ad4-4964-8070-f90bb952e2fa tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:54.609821 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-48269d5d-2ad4-4964-8070-f90bb952e2fa tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:54.631452 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-48269d5d-2ad4-4964-8070-f90bb952e2fa tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1521 microversion: 2.1 time: 0.335789 Jul 12 14:40:54.632657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 113/239] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:54 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:54.780191 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c591d868-21e5-4f75-9d44-24bf0f3d9d6c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:54.781459 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-c591d868-21e5-4f75-9d44-24bf0f3d9d6c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:54.790320 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c591d868-21e5-4f75-9d44-24bf0f3d9d6c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:54.791053 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c591d868-21e5-4f75-9d44-24bf0f3d9d6c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:54.792194 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c591d868-21e5-4f75-9d44-24bf0f3d9d6c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:54.792726 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c591d868-21e5-4f75-9d44-24bf0f3d9d6c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:55.164165 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c591d868-21e5-4f75-9d44-24bf0f3d9d6c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:55.175092 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-c591d868-21e5-4f75-9d44-24bf0f3d9d6c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1553 microversion: 2.1 time: 0.398862 Jul 12 14:40:55.176365 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 127/240] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:54 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1553 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:55.649624 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-73b23259-c640-4700-aba9-5bf3047ad7d2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:55.651158 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-73b23259-c640-4700-aba9-5bf3047ad7d2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:55.660437 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-73b23259-c640-4700-aba9-5bf3047ad7d2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:55.661037 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-73b23259-c640-4700-aba9-5bf3047ad7d2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:55.662775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-73b23259-c640-4700-aba9-5bf3047ad7d2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:55.663442 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-73b23259-c640-4700-aba9-5bf3047ad7d2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:56.090567 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-73b23259-c640-4700-aba9-5bf3047ad7d2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:56.102559 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-73b23259-c640-4700-aba9-5bf3047ad7d2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1521 microversion: 2.1 time: 0.457021 Jul 12 14:40:56.112392 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 114/241] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:55 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:56.199516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-dab01c07-cea6-4602-9dac-cb32b4409560 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:56.200153 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-dab01c07-cea6-4602-9dac-cb32b4409560 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:56.209217 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-dab01c07-cea6-4602-9dac-cb32b4409560 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:56.209667 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-dab01c07-cea6-4602-9dac-cb32b4409560 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:56.210503 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-dab01c07-cea6-4602-9dac-cb32b4409560 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:56.211055 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-dab01c07-cea6-4602-9dac-cb32b4409560 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:56.408598 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-dab01c07-cea6-4602-9dac-cb32b4409560 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:56.447134 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-5ebc4e40-cd6c-42f3-9813-799e09b51d00 req-1e21f132-e2e9-4940-b966-47b6405377ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be1b083-8bbf-47a2-bcd3-015cd173afa1", "name": "network-vif-deleted", "tag": "f286bedd-3258-42e6-b8d5-c69bf1cec4da"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:40:56.447782 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-dab01c07-cea6-4602-9dac-cb32b4409560 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1511 microversion: 2.1 time: 0.257957 Jul 12 14:40:56.455817 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 128/242] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:56 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1511 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:56.462871 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-5ebc4e40-cd6c-42f3-9813-799e09b51d00 req-1e21f132-e2e9-4940-b966-47b6405377ad service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:56.465066 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-5ebc4e40-cd6c-42f3-9813-799e09b51d00 req-1e21f132-e2e9-4940-b966-47b6405377ad service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:56.488488 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-5ebc4e40-cd6c-42f3-9813-799e09b51d00 req-1e21f132-e2e9-4940-b966-47b6405377ad service nova] Creating event network-vif-deleted:f286bedd-3258-42e6-b8d5-c69bf1cec4da for instance 4be1b083-8bbf-47a2-bcd3-015cd173afa1 on hv-cinder-82002 Jul 12 14:40:56.497926 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-5ebc4e40-cd6c-42f3-9813-799e09b51d00 req-1e21f132-e2e9-4940-b966-47b6405377ad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054177 Jul 12 14:40:56.499070 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 115/243] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:40:57.120327 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-1741fe29-0c4d-4b3b-87d4-e2af772873db tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:57.122747 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-1741fe29-0c4d-4b3b-87d4-e2af772873db tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:57.124610 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_api:SELECT=73 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:57.141478 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1741fe29-0c4d-4b3b-87d4-e2af772873db tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:57.142103 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1741fe29-0c4d-4b3b-87d4-e2af772873db tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:57.145272 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1741fe29-0c4d-4b3b-87d4-e2af772873db tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:57.146657 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1741fe29-0c4d-4b3b-87d4-e2af772873db tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:57.415464 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-1741fe29-0c4d-4b3b-87d4-e2af772873db tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:57.431389 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-1741fe29-0c4d-4b3b-87d4-e2af772873db tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1521 microversion: 2.1 time: 0.309687 Jul 12 14:40:57.431389 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 129/244] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:57 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:57.467650 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-3f6d87bb-4690-4cc2-8849-a3845d21a7a9 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:57.470054 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-3f6d87bb-4690-4cc2-8849-a3845d21a7a9 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:57.480676 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3f6d87bb-4690-4cc2-8849-a3845d21a7a9 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:57.481384 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3f6d87bb-4690-4cc2-8849-a3845d21a7a9 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:57.482502 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3f6d87bb-4690-4cc2-8849-a3845d21a7a9 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:57.483090 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3f6d87bb-4690-4cc2-8849-a3845d21a7a9 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:57.612549 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-3f6d87bb-4690-4cc2-8849-a3845d21a7a9 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e06ab7cd924e07a79efaafa078a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165d7892df2f450d927c92d71cd96f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:57.640377 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-3f6d87bb-4690-4cc2-8849-a3845d21a7a9 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 200 len: 1346 microversion: 2.1 time: 0.166563 Jul 12 14:40:57.649845 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 116/245] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:57 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 1346 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:58.449994 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-34f4af0c-ccf2-4526-bdd8-8319cfdd20ee tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:58.450605 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-34f4af0c-ccf2-4526-bdd8-8319cfdd20ee tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:58.467102 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-34f4af0c-ccf2-4526-bdd8-8319cfdd20ee tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:58.467564 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-34f4af0c-ccf2-4526-bdd8-8319cfdd20ee tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:58.468349 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-34f4af0c-ccf2-4526-bdd8-8319cfdd20ee tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:58.468789 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-34f4af0c-ccf2-4526-bdd8-8319cfdd20ee tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:58.623988 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-34f4af0c-ccf2-4526-bdd8-8319cfdd20ee tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:58.632463 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-34f4af0c-ccf2-4526-bdd8-8319cfdd20ee tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1521 microversion: 2.1 time: 0.188248 Jul 12 14:40:58.643597 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 130/246] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:58 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:58.660789 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-41fd9360-fb85-4b5f-aeeb-8de7f267ef8c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:58.661920 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-41fd9360-fb85-4b5f-aeeb-8de7f267ef8c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:58.673044 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-41fd9360-fb85-4b5f-aeeb-8de7f267ef8c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:58.673719 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-41fd9360-fb85-4b5f-aeeb-8de7f267ef8c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:58.677943 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-41fd9360-fb85-4b5f-aeeb-8de7f267ef8c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:58.677943 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-41fd9360-fb85-4b5f-aeeb-8de7f267ef8c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:58.703923 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.wsgi [None req-41fd9360-fb85-4b5f-aeeb-8de7f267ef8c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] HTTP exception thrown: Instance 4be1b083-8bbf-47a2-bcd3-015cd173afa1 could not be found. Jul 12 14:40:58.710837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-41fd9360-fb85-4b5f-aeeb-8de7f267ef8c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Request method failure captured: Jul 12 14:40:58.710837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: request: GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 HTTP/1.1 Jul 12 14:40:58.710837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept: application/json Jul 12 14:40:58.710837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept-Encoding: identity Jul 12 14:40:58.710837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Connection: close Jul 12 14:40:58.710837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Length: 0 Jul 12 14:40:58.710837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Type: application/json Jul 12 14:40:58.710837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Host: 10.222.0.30 Jul 12 14:40:58.710837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Openstack-System-Scope: None Jul 12 14:40:58.710837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: User-Agent: python-urllib3/1.26.9 Jul 12 14:40:58.710837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Auth-Token: gAAAAABizYemOPb5wHpcehi71pm7lXqrKpTojOEtDrr6n4tAsClmfxiJp2Cgp13tFXpBuTOsdyeo_UHI33OgrYmNuwUz8UfHW-Yr4MUxWihHgagYHxhdJ8HZSSl4k-UZaBtVn6k5GGWXaQVIrxJvOkO7GyVy0NGFGbyFMujdbLfVRSaICLmrgeI Jul 12 14:40:58.710837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Id: None Jul 12 14:40:58.710837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Name: None Jul 12 14:40:58.710837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Identity-Status: Confirmed Jul 12 14:40:58.710837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Is-Admin-Project: True Jul 12 14:40:58.710837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Id: default Jul 12 14:40:58.710837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Name: Default Jul 12 14:40:58.710837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Id: 165d7892df2f450d927c92d71cd96f29 Jul 12 14:40:58.710837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Name: tempest-DeleteServersTestJSON-1178119775 Jul 12 14:40:58.710837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Role: member,reader Jul 12 14:40:58.710837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Roles: member,reader Jul 12 14:40:58.712412 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/165d7892df2f450d927c92d71cd96f29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/165d7892df2f450d927c92d71cd96f29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/165d7892df2f450d927c92d71cd96f29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_165d7892df2f450d927c92d71cd96f29", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:40:58.712412 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant: tempest-DeleteServersTestJSON-1178119775 Jul 12 14:40:58.712412 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Id: 165d7892df2f450d927c92d71cd96f29 Jul 12 14:40:58.712412 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178119775 Jul 12 14:40:58.712412 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User: tempest-DeleteServersTestJSON-1178119775-project Jul 12 14:40:58.712412 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Id: default Jul 12 14:40:58.712412 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Name: Default Jul 12 14:40:58.712412 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Id: 83e06ab7cd924e07a79efaafa078a174 Jul 12 14:40:58.712412 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Name: tempest-DeleteServersTestJSON-1178119775-project Jul 12 14:40:58.712412 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: method: > Jul 12 14:40:58.712412 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: exception: Instance 4be1b083-8bbf-47a2-bcd3-015cd173afa1 could not be found. Jul 12 14:40:58.712412 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: action_args: {'id': '4be1b083-8bbf-47a2-bcd3-015cd173afa1'} Jul 12 14:40:58.713308 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:40:58.713308 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:40:58.713308 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:40:58.713308 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:40:58.713308 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:40:58.713308 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:40:58.713308 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:40:58.713308 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:40:58.713308 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:40:58.713308 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:40:58.713308 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4be1b083-8bbf-47a2-bcd3-015cd173afa1 could not be found. Jul 12 14:40:58.713308 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:40:58.713308 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:40:58.713308 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:40:58.713308 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:40:58.713308 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:40:58.713308 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:40:58.713308 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:40:58.713308 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:40:58.713308 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:40:58.715055 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:40:58.715055 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:40:58.715055 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:40:58.715055 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:40:58.715055 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:40:58.715055 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:40:58.715055 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:40:58.715055 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4be1b083-8bbf-47a2-bcd3-015cd173afa1 could not be found. Jul 12 14:40:58.715055 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:40:58.715055 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:40:58.715055 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:40:58.715055 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:40:58.715055 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:40:58.715055 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:40:58.715055 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:40:58.715055 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:40:58.715055 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4be1b083-8bbf-47a2-bcd3-015cd173afa1 could not be found. Jul 12 14:40:58.715055 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:40:58.719041 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-41fd9360-fb85-4b5f-aeeb-8de7f267ef8c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Returning 404 to user: Instance 4be1b083-8bbf-47a2-bcd3-015cd173afa1 could not be found. {{(pid=129980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:40:58.720026 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-41fd9360-fb85-4b5f-aeeb-8de7f267ef8c tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 404 len: 111 microversion: 2.1 time: 0.065177 Jul 12 14:40:58.721030 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 117/247] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:58 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:40:58.864164 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d1619a08-4d21-4dd9-b49d-728984e32cb7 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:58.865448 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-d1619a08-4d21-4dd9-b49d-728984e32cb7 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:58.876674 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d1619a08-4d21-4dd9-b49d-728984e32cb7 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:58.877317 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d1619a08-4d21-4dd9-b49d-728984e32cb7 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:58.878243 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d1619a08-4d21-4dd9-b49d-728984e32cb7 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:58.879012 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d1619a08-4d21-4dd9-b49d-728984e32cb7 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:58.894342 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.wsgi [None req-d1619a08-4d21-4dd9-b49d-728984e32cb7 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] HTTP exception thrown: Instance 4be1b083-8bbf-47a2-bcd3-015cd173afa1 could not be found. Jul 12 14:40:58.898674 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d1619a08-4d21-4dd9-b49d-728984e32cb7 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Request method failure captured: Jul 12 14:40:58.898674 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1/os-volume_attachments HTTP/1.1 Jul 12 14:40:58.898674 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:40:58.898674 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:40:58.898674 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:40:58.898674 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 0 Jul 12 14:40:58.898674 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:40:58.898674 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:40:58.898674 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:40:58.898674 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:40:58.898674 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYemOPb5wHpcehi71pm7lXqrKpTojOEtDrr6n4tAsClmfxiJp2Cgp13tFXpBuTOsdyeo_UHI33OgrYmNuwUz8UfHW-Yr4MUxWihHgagYHxhdJ8HZSSl4k-UZaBtVn6k5GGWXaQVIrxJvOkO7GyVy0NGFGbyFMujdbLfVRSaICLmrgeI Jul 12 14:40:58.898674 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:40:58.898674 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:40:58.898674 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:40:58.898674 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:40:58.898674 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:40:58.898674 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:40:58.898674 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: 165d7892df2f450d927c92d71cd96f29 Jul 12 14:40:58.898674 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-DeleteServersTestJSON-1178119775 Jul 12 14:40:58.898674 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:40:58.898674 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:40:58.900066 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/165d7892df2f450d927c92d71cd96f29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/165d7892df2f450d927c92d71cd96f29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/165d7892df2f450d927c92d71cd96f29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_165d7892df2f450d927c92d71cd96f29", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:40:58.900066 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-DeleteServersTestJSON-1178119775 Jul 12 14:40:58.900066 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: 165d7892df2f450d927c92d71cd96f29 Jul 12 14:40:58.900066 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178119775 Jul 12 14:40:58.900066 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-DeleteServersTestJSON-1178119775-project Jul 12 14:40:58.900066 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:40:58.900066 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:40:58.900066 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: 83e06ab7cd924e07a79efaafa078a174 Jul 12 14:40:58.900066 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-DeleteServersTestJSON-1178119775-project Jul 12 14:40:58.900066 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: > Jul 12 14:40:58.900066 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Instance 4be1b083-8bbf-47a2-bcd3-015cd173afa1 could not be found. Jul 12 14:40:58.900066 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'server_id': '4be1b083-8bbf-47a2-bcd3-015cd173afa1'} Jul 12 14:40:58.900872 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:40:58.900872 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:40:58.900872 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:40:58.900872 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:40:58.900872 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:40:58.900872 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:40:58.900872 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:40:58.900872 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:40:58.900872 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:40:58.900872 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:40:58.900872 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4be1b083-8bbf-47a2-bcd3-015cd173afa1 could not be found. Jul 12 14:40:58.900872 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:40:58.900872 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:40:58.900872 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:40:58.900872 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:40:58.900872 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:40:58.900872 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:40:58.900872 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:40:58.900872 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:40:58.900872 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:40:58.902494 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:40:58.902494 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 14:40:58.902494 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 14:40:58.902494 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 14:40:58.902494 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 14:40:58.902494 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 12 14:40:58.902494 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 12 14:40:58.902494 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:40:58.902494 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:40:58.902494 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4be1b083-8bbf-47a2-bcd3-015cd173afa1 could not be found. Jul 12 14:40:58.902494 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:40:58.902494 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:40:58.902494 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:40:58.902494 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:40:58.902494 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:40:58.902494 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:40:58.902494 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:40:58.902494 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:40:58.902494 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4be1b083-8bbf-47a2-bcd3-015cd173afa1 could not be found. Jul 12 14:40:58.902494 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:40:58.904005 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d1619a08-4d21-4dd9-b49d-728984e32cb7 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Returning 404 to user: Instance 4be1b083-8bbf-47a2-bcd3-015cd173afa1 could not be found. {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:40:58.904005 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-d1619a08-4d21-4dd9-b49d-728984e32cb7 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040314 Jul 12 14:40:58.912291 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 131/248] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Jul 12 14:40:58 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:40:59.650520 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-04264e7e-22a8-4e9f-ab8d-9ef03ebe81d5 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:59.652106 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-04264e7e-22a8-4e9f-ab8d-9ef03ebe81d5 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:59.685363 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-04264e7e-22a8-4e9f-ab8d-9ef03ebe81d5 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:59.685946 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-04264e7e-22a8-4e9f-ab8d-9ef03ebe81d5 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:59.688735 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-04264e7e-22a8-4e9f-ab8d-9ef03ebe81d5 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:59.688735 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-04264e7e-22a8-4e9f-ab8d-9ef03ebe81d5 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:59.974034 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-04264e7e-22a8-4e9f-ab8d-9ef03ebe81d5 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:59.979184 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-04264e7e-22a8-4e9f-ab8d-9ef03ebe81d5 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1521 microversion: 2.1 time: 0.333461 Jul 12 14:40:59.980004 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 118/249] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:59 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:41:00.288719 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-2f8c1421-2812-4e9a-87b7-91ec2921bf69 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:00.289237 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-2f8c1421-2812-4e9a-87b7-91ec2921bf69 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:00.295261 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2f8c1421-2812-4e9a-87b7-91ec2921bf69 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:00.295710 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2f8c1421-2812-4e9a-87b7-91ec2921bf69 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:00.296463 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2f8c1421-2812-4e9a-87b7-91ec2921bf69 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:00.296889 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2f8c1421-2812-4e9a-87b7-91ec2921bf69 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:00.317970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.wsgi [None req-2f8c1421-2812-4e9a-87b7-91ec2921bf69 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] HTTP exception thrown: Instance 4be1b083-8bbf-47a2-bcd3-015cd173afa1 could not be found. Jul 12 14:41:00.317970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-2f8c1421-2812-4e9a-87b7-91ec2921bf69 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Request method failure captured: Jul 12 14:41:00.317970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: DELETE /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 HTTP/1.1 Jul 12 14:41:00.317970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:41:00.317970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:41:00.317970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:41:00.317970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 0 Jul 12 14:41:00.317970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:41:00.317970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:41:00.317970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:41:00.317970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:41:00.317970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYemOPb5wHpcehi71pm7lXqrKpTojOEtDrr6n4tAsClmfxiJp2Cgp13tFXpBuTOsdyeo_UHI33OgrYmNuwUz8UfHW-Yr4MUxWihHgagYHxhdJ8HZSSl4k-UZaBtVn6k5GGWXaQVIrxJvOkO7GyVy0NGFGbyFMujdbLfVRSaICLmrgeI Jul 12 14:41:00.317970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:41:00.317970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:41:00.317970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:41:00.317970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:41:00.317970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:41:00.317970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:41:00.317970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: 165d7892df2f450d927c92d71cd96f29 Jul 12 14:41:00.317970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-DeleteServersTestJSON-1178119775 Jul 12 14:41:00.317970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:41:00.317970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:41:00.319830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/165d7892df2f450d927c92d71cd96f29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/165d7892df2f450d927c92d71cd96f29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/165d7892df2f450d927c92d71cd96f29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_165d7892df2f450d927c92d71cd96f29", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:41:00.319830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-DeleteServersTestJSON-1178119775 Jul 12 14:41:00.319830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: 165d7892df2f450d927c92d71cd96f29 Jul 12 14:41:00.319830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178119775 Jul 12 14:41:00.319830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-DeleteServersTestJSON-1178119775-project Jul 12 14:41:00.319830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:41:00.319830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:41:00.319830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: 83e06ab7cd924e07a79efaafa078a174 Jul 12 14:41:00.319830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-DeleteServersTestJSON-1178119775-project Jul 12 14:41:00.319830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: > Jul 12 14:41:00.319830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Instance 4be1b083-8bbf-47a2-bcd3-015cd173afa1 could not be found. Jul 12 14:41:00.319830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'id': '4be1b083-8bbf-47a2-bcd3-015cd173afa1'} Jul 12 14:41:00.320644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:41:00.320644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:41:00.320644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:41:00.320644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:41:00.320644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:41:00.320644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:41:00.320644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:41:00.320644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:41:00.320644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:41:00.320644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:41:00.320644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4be1b083-8bbf-47a2-bcd3-015cd173afa1 could not be found. Jul 12 14:41:00.320644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:41:00.320644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:41:00.320644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:41:00.320644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:41:00.320644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:41:00.320644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:41:00.320644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:41:00.320644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:41:00.320644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:41:00.322284 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:41:00.322284 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 14:41:00.322284 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 14:41:00.322284 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 14:41:00.322284 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 14:41:00.322284 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:41:00.322284 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:41:00.322284 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:41:00.322284 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:41:00.322284 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4be1b083-8bbf-47a2-bcd3-015cd173afa1 could not be found. Jul 12 14:41:00.322284 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:41:00.322284 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:41:00.322284 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:41:00.322284 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:41:00.322284 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:41:00.322284 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:41:00.322284 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:41:00.322284 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:41:00.322284 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4be1b083-8bbf-47a2-bcd3-015cd173afa1 could not be found. Jul 12 14:41:00.322284 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:41:00.324564 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-2f8c1421-2812-4e9a-87b7-91ec2921bf69 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Returning 404 to user: Instance 4be1b083-8bbf-47a2-bcd3-015cd173afa1 could not be found. {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:41:00.324564 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-2f8c1421-2812-4e9a-87b7-91ec2921bf69 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 404 len: 111 microversion: 2.1 time: 0.029973 Jul 12 14:41:00.324564 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 132/250] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Jul 12 14:41:00 2022] DELETE /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:41:00.329705 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-86a12b85-69ed-4ae2-822c-71fc3baec979 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:00.330559 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-86a12b85-69ed-4ae2-822c-71fc3baec979 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] [instance: 4be1b083-8bbf-47a2-bcd3-015cd173afa1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:00.348489 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-86a12b85-69ed-4ae2-822c-71fc3baec979 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:00.349889 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-86a12b85-69ed-4ae2-822c-71fc3baec979 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:00.350744 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-86a12b85-69ed-4ae2-822c-71fc3baec979 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:00.351187 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-86a12b85-69ed-4ae2-822c-71fc3baec979 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:00.373540 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.wsgi [None req-86a12b85-69ed-4ae2-822c-71fc3baec979 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] HTTP exception thrown: Instance 4be1b083-8bbf-47a2-bcd3-015cd173afa1 could not be found. Jul 12 14:41:00.379834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-86a12b85-69ed-4ae2-822c-71fc3baec979 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Request method failure captured: Jul 12 14:41:00.379834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: request: GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 HTTP/1.1 Jul 12 14:41:00.379834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept: application/json Jul 12 14:41:00.379834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept-Encoding: identity Jul 12 14:41:00.379834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Connection: close Jul 12 14:41:00.379834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Length: 0 Jul 12 14:41:00.379834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Type: application/json Jul 12 14:41:00.379834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Host: 10.222.0.30 Jul 12 14:41:00.379834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Openstack-System-Scope: None Jul 12 14:41:00.379834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: User-Agent: python-urllib3/1.26.9 Jul 12 14:41:00.379834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Auth-Token: gAAAAABizYemOPb5wHpcehi71pm7lXqrKpTojOEtDrr6n4tAsClmfxiJp2Cgp13tFXpBuTOsdyeo_UHI33OgrYmNuwUz8UfHW-Yr4MUxWihHgagYHxhdJ8HZSSl4k-UZaBtVn6k5GGWXaQVIrxJvOkO7GyVy0NGFGbyFMujdbLfVRSaICLmrgeI Jul 12 14:41:00.379834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Id: None Jul 12 14:41:00.379834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Name: None Jul 12 14:41:00.379834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Identity-Status: Confirmed Jul 12 14:41:00.379834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Is-Admin-Project: True Jul 12 14:41:00.379834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Id: default Jul 12 14:41:00.379834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Name: Default Jul 12 14:41:00.379834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Id: 165d7892df2f450d927c92d71cd96f29 Jul 12 14:41:00.379834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Name: tempest-DeleteServersTestJSON-1178119775 Jul 12 14:41:00.379834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Role: member,reader Jul 12 14:41:00.379834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Roles: member,reader Jul 12 14:41:00.381446 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/165d7892df2f450d927c92d71cd96f29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/165d7892df2f450d927c92d71cd96f29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/165d7892df2f450d927c92d71cd96f29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_165d7892df2f450d927c92d71cd96f29", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:41:00.381446 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant: tempest-DeleteServersTestJSON-1178119775 Jul 12 14:41:00.381446 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Id: 165d7892df2f450d927c92d71cd96f29 Jul 12 14:41:00.381446 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178119775 Jul 12 14:41:00.381446 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User: tempest-DeleteServersTestJSON-1178119775-project Jul 12 14:41:00.381446 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Id: default Jul 12 14:41:00.381446 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Name: Default Jul 12 14:41:00.381446 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Id: 83e06ab7cd924e07a79efaafa078a174 Jul 12 14:41:00.381446 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Name: tempest-DeleteServersTestJSON-1178119775-project Jul 12 14:41:00.381446 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: method: > Jul 12 14:41:00.381446 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: exception: Instance 4be1b083-8bbf-47a2-bcd3-015cd173afa1 could not be found. Jul 12 14:41:00.381446 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: action_args: {'id': '4be1b083-8bbf-47a2-bcd3-015cd173afa1'} Jul 12 14:41:00.382238 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:41:00.382238 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:41:00.382238 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:41:00.382238 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:41:00.382238 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:41:00.382238 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:41:00.382238 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:41:00.382238 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:41:00.382238 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:41:00.382238 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:41:00.382238 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4be1b083-8bbf-47a2-bcd3-015cd173afa1 could not be found. Jul 12 14:41:00.382238 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:41:00.382238 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:41:00.382238 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:41:00.382238 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:41:00.382238 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:41:00.382238 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:41:00.382238 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:41:00.382238 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:41:00.382238 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:41:00.383510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:41:00.383510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:41:00.383510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:41:00.383510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:41:00.383510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:41:00.383510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:41:00.383510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:41:00.383510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4be1b083-8bbf-47a2-bcd3-015cd173afa1 could not be found. Jul 12 14:41:00.383510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:41:00.383510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:41:00.383510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:41:00.383510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:41:00.383510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:41:00.383510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:41:00.383510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:41:00.383510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:41:00.383510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4be1b083-8bbf-47a2-bcd3-015cd173afa1 could not be found. Jul 12 14:41:00.383510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:41:00.384794 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-86a12b85-69ed-4ae2-822c-71fc3baec979 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] Returning 404 to user: Instance 4be1b083-8bbf-47a2-bcd3-015cd173afa1 could not be found. {{(pid=129980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:41:00.384794 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-86a12b85-69ed-4ae2-822c-71fc3baec979 tempest-DeleteServersTestJSON-1178119775 tempest-DeleteServersTestJSON-1178119775-project] 10.222.0.30 "GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1" status: 404 len: 111 microversion: 2.1 time: 0.051544 Jul 12 14:41:00.384794 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 119/251] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:00 2022] GET /compute/v2.1/servers/4be1b083-8bbf-47a2-bcd3-015cd173afa1 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:41:00.998389 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-f2801885-2702-4b8f-9eef-17c4d63c6b2b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:00.999281 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-f2801885-2702-4b8f-9eef-17c4d63c6b2b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:01.018708 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f2801885-2702-4b8f-9eef-17c4d63c6b2b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:01.021391 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f2801885-2702-4b8f-9eef-17c4d63c6b2b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:01.037230 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f2801885-2702-4b8f-9eef-17c4d63c6b2b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:01.037230 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f2801885-2702-4b8f-9eef-17c4d63c6b2b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:01.493924 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-f2801885-2702-4b8f-9eef-17c4d63c6b2b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:01.504562 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-f2801885-2702-4b8f-9eef-17c4d63c6b2b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1521 microversion: 2.1 time: 0.512073 Jul 12 14:41:01.505247 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 133/252] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:00 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1521 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:02.522246 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-8b3497da-bf9d-48e3-be59-f91dbf447b62 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:02.524358 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-8b3497da-bf9d-48e3-be59-f91dbf447b62 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:02.536664 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8b3497da-bf9d-48e3-be59-f91dbf447b62 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:02.537170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8b3497da-bf9d-48e3-be59-f91dbf447b62 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:02.537984 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8b3497da-bf9d-48e3-be59-f91dbf447b62 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:02.538435 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8b3497da-bf9d-48e3-be59-f91dbf447b62 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:02.924650 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-8b3497da-bf9d-48e3-be59-f91dbf447b62 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:02.952934 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-8b3497da-bf9d-48e3-be59-f91dbf447b62 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1521 microversion: 2.1 time: 0.434493 Jul 12 14:41:02.955336 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 120/253] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:02 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1521 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:03.974034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-6bc14f13-b745-4ce5-b80a-24ba12ef6ec3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:03.978299 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-6bc14f13-b745-4ce5-b80a-24ba12ef6ec3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:03.986726 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6bc14f13-b745-4ce5-b80a-24ba12ef6ec3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:03.987451 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6bc14f13-b745-4ce5-b80a-24ba12ef6ec3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:03.988401 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6bc14f13-b745-4ce5-b80a-24ba12ef6ec3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:03.988996 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6bc14f13-b745-4ce5-b80a-24ba12ef6ec3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:04.264090 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-6bc14f13-b745-4ce5-b80a-24ba12ef6ec3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:04.279654 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-6bc14f13-b745-4ce5-b80a-24ba12ef6ec3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1501 microversion: 2.1 time: 0.309353 Jul 12 14:41:04.294250 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 134/254] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:03 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1501 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:04.299122 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-8f185f4d-7ac5-42c0-97e1-0c604bad8de4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:04.299973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-8f185f4d-7ac5-42c0-97e1-0c604bad8de4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:04.318463 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8f185f4d-7ac5-42c0-97e1-0c604bad8de4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:04.318463 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8f185f4d-7ac5-42c0-97e1-0c604bad8de4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:04.320801 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8f185f4d-7ac5-42c0-97e1-0c604bad8de4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:04.321310 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8f185f4d-7ac5-42c0-97e1-0c604bad8de4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:04.648320 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-8f185f4d-7ac5-42c0-97e1-0c604bad8de4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:04.662296 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-8f185f4d-7ac5-42c0-97e1-0c604bad8de4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1516 microversion: 2.1 time: 0.363815 Jul 12 14:41:04.662296 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 121/255] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:04 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1516 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:41:06.704553 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-6c73e8da-ce8f-4209-a030-995a87874968 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:41:06.705622 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-6c73e8da-ce8f-4209-a030-995a87874968 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:06.712338 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6c73e8da-ce8f-4209-a030-995a87874968 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:06.714075 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6c73e8da-ce8f-4209-a030-995a87874968 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:06.715103 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6c73e8da-ce8f-4209-a030-995a87874968 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:06.715548 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6c73e8da-ce8f-4209-a030-995a87874968 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:06.742354 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.objects.instance [None req-6c73e8da-ce8f-4209-a030-995a87874968 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lazy-loading 'flavor' on Instance uuid 2e8ad66c-747a-4266-9452-a45bfeefa6c7 {{(pid=129981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:41:07.174454 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-6c73e8da-ce8f-4209-a030-995a87874968 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "POST /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7/action" status: 200 len: 32 microversion: 2.1 time: 0.473916 Jul 12 14:41:07.175045 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 135/256] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Jul 12 14:41:06 2022] POST /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7/action => generated 32 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 14:41:07.191404 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-9f1573e6-c310-45d3-b9a4-ffd4ce8df30a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:07.195069 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-9f1573e6-c310-45d3-b9a4-ffd4ce8df30a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:07.208272 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9f1573e6-c310-45d3-b9a4-ffd4ce8df30a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:07.208732 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9f1573e6-c310-45d3-b9a4-ffd4ce8df30a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:07.209540 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9f1573e6-c310-45d3-b9a4-ffd4ce8df30a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:07.209975 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9f1573e6-c310-45d3-b9a4-ffd4ce8df30a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:07.431068 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-9f1573e6-c310-45d3-b9a4-ffd4ce8df30a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:07.444628 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-9f1573e6-c310-45d3-b9a4-ffd4ce8df30a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.264151 Jul 12 14:41:07.450103 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 122/257] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:07 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:08.469642 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-58bcef2a-24b3-4233-ab35-3fbe6e626ade tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:08.470349 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-58bcef2a-24b3-4233-ab35-3fbe6e626ade tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:08.482397 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-58bcef2a-24b3-4233-ab35-3fbe6e626ade tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:08.487596 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-58bcef2a-24b3-4233-ab35-3fbe6e626ade tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:08.487596 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-58bcef2a-24b3-4233-ab35-3fbe6e626ade tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:08.487596 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-58bcef2a-24b3-4233-ab35-3fbe6e626ade tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:08.658945 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-58bcef2a-24b3-4233-ab35-3fbe6e626ade tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:08.669645 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-58bcef2a-24b3-4233-ab35-3fbe6e626ade tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.204361 Jul 12 14:41:08.670757 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 136/258] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:08 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:09.687467 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-cdb86bd4-95a2-44fe-8f16-8a26c2f11816 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:09.688727 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-cdb86bd4-95a2-44fe-8f16-8a26c2f11816 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:09.697938 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-cdb86bd4-95a2-44fe-8f16-8a26c2f11816 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:09.698741 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-cdb86bd4-95a2-44fe-8f16-8a26c2f11816 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:09.699672 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-cdb86bd4-95a2-44fe-8f16-8a26c2f11816 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:09.700767 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-cdb86bd4-95a2-44fe-8f16-8a26c2f11816 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:09.925516 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-cdb86bd4-95a2-44fe-8f16-8a26c2f11816 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:09.935079 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-cdb86bd4-95a2-44fe-8f16-8a26c2f11816 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.251374 Jul 12 14:41:09.936453 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 123/259] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:09 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:10.959987 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-4579d1d2-2d28-4784-9c93-383a5194e68e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:10.973352 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-4579d1d2-2d28-4784-9c93-383a5194e68e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:10.980329 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4579d1d2-2d28-4784-9c93-383a5194e68e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:10.981179 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4579d1d2-2d28-4784-9c93-383a5194e68e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:10.982119 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4579d1d2-2d28-4784-9c93-383a5194e68e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:10.982701 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4579d1d2-2d28-4784-9c93-383a5194e68e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:11.131363 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-4579d1d2-2d28-4784-9c93-383a5194e68e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:11.140040 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-4579d1d2-2d28-4784-9c93-383a5194e68e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.187109 Jul 12 14:41:11.140676 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 137/260] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:10 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:12.156723 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-def4eaa9-3db2-4843-8963-4a8123fc1849 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:12.157359 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-def4eaa9-3db2-4843-8963-4a8123fc1849 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:12.164597 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-def4eaa9-3db2-4843-8963-4a8123fc1849 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:12.164597 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-def4eaa9-3db2-4843-8963-4a8123fc1849 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:12.165558 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-def4eaa9-3db2-4843-8963-4a8123fc1849 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:12.166805 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-def4eaa9-3db2-4843-8963-4a8123fc1849 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:12.343843 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-def4eaa9-3db2-4843-8963-4a8123fc1849 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:12.355337 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-def4eaa9-3db2-4843-8963-4a8123fc1849 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.199504 Jul 12 14:41:12.356418 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 124/261] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:12 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:13.373062 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-00767588-9820-4a93-b6ce-deaaa0929a03 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:13.374591 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-00767588-9820-4a93-b6ce-deaaa0929a03 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:13.381805 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-00767588-9820-4a93-b6ce-deaaa0929a03 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:13.382437 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-00767588-9820-4a93-b6ce-deaaa0929a03 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:13.383514 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-00767588-9820-4a93-b6ce-deaaa0929a03 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:13.384214 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-00767588-9820-4a93-b6ce-deaaa0929a03 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:13.407408 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:13.566211 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-00767588-9820-4a93-b6ce-deaaa0929a03 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:13.573955 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-00767588-9820-4a93-b6ce-deaaa0929a03 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.205887 Jul 12 14:41:13.574574 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 138/262] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:13 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:14.592270 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-29fe4608-d622-45c9-8d1f-48dc79f97acf tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:14.592986 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-29fe4608-d622-45c9-8d1f-48dc79f97acf tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:14.600350 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-29fe4608-d622-45c9-8d1f-48dc79f97acf tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:14.601100 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-29fe4608-d622-45c9-8d1f-48dc79f97acf tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:14.602292 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-29fe4608-d622-45c9-8d1f-48dc79f97acf tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:14.602884 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-29fe4608-d622-45c9-8d1f-48dc79f97acf tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:14.745564 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-29fe4608-d622-45c9-8d1f-48dc79f97acf tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:14.749349 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:14.753838 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-29fe4608-d622-45c9-8d1f-48dc79f97acf tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.166223 Jul 12 14:41:14.754359 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 125/263] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:14 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:15.016032 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-ba46ce82-f582-4ecc-92fd-4f208445cb13 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Action: 'create', calling method: .version_select at 0x7f962d4505e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-186415476", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ44IEEI5HJCgPLumTokCZ1MeFRZnS3cKMzPUYitfQ10WHdJ5oBhpWtHDqXJ8v5kA5KTY8eIOJWNd5Y1liy/MK1RYoy4R1NvESULIxtbnN79DNQa/MD3kNjL31HDPzU1HA=="}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:41:15.036360 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.quota [None req-ba46ce82-f582-4ecc-92fd-4f208445cb13 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Getting quotas for project 47cd27ad4219485cae0d8d85a2823948. Resources: {'key_pairs'} {{(pid=129981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:41:15.040218 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.quota [None req-ba46ce82-f582-4ecc-92fd-4f208445cb13 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Getting quotas for user 92fed4b668e246f6b1b89a888c34f107 and project 47cd27ad4219485cae0d8d85a2823948. Resources: {'key_pairs'} {{(pid=129981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:41:15.148336 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-ba46ce82-f582-4ecc-92fd-4f208445cb13 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.136325 Jul 12 14:41:15.148933 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 139/264] 10.222.0.30 () {60 vars in 1158 bytes} [Tue Jul 12 14:41:15 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:41:15.248064 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-2f41d51c-576f-4375-a489-a15575876c50 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-710274661", "imageRef": "f551c41d-4e35-4625-a904-b764cd199b9d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-186415476", "networks": [{"uuid": "84dbba96-4890-4894-8f65-f9b63f7010e5"}]}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:41:15.303077 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.network.neutron [None req-2f41d51c-576f-4375-a489-a15575876c50 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] validate_networks() for [('84dbba96-4890-4894-8f65-f9b63f7010e5', None, None, None, None, None)] {{(pid=129980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:41:15.687648 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-2f41d51c-576f-4375-a489-a15575876c50 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Flavor limits 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:41:15.688238 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-2f41d51c-576f-4375-a489-a15575876c50 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Image limits 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:41:15.688499 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-2f41d51c-576f-4375-a489-a15575876c50 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Flavor pref 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:41:15.688904 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-2f41d51c-576f-4375-a489-a15575876c50 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Image pref 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:41:15.689357 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-2f41d51c-576f-4375-a489-a15575876c50 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:41:15.699669 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2f41d51c-576f-4375-a489-a15575876c50 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:15.700118 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2f41d51c-576f-4375-a489-a15575876c50 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:15.705835 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2f41d51c-576f-4375-a489-a15575876c50 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:15.705835 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2f41d51c-576f-4375-a489-a15575876c50 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:15.718141 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-2f41d51c-576f-4375-a489-a15575876c50 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Getting quotas for project 47cd27ad4219485cae0d8d85a2823948. Resources: {'instances', 'cores', 'ram'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:41:15.722050 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-2f41d51c-576f-4375-a489-a15575876c50 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Getting quotas for user 92fed4b668e246f6b1b89a888c34f107 and project 47cd27ad4219485cae0d8d85a2823948. Resources: {'instances', 'cores', 'ram'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:41:15.733060 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-2f41d51c-576f-4375-a489-a15575876c50 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Going to run 1 instances... {{(pid=129980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:41:15.735260 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-2f41d51c-576f-4375-a489-a15575876c50 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f551c41d-4e35-4625-a904-b764cd199b9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:41:15.770894 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-afc90ec1-30f3-45b1-9d0e-f549b738224b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:15.771483 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-afc90ec1-30f3-45b1-9d0e-f549b738224b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:15.780087 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-afc90ec1-30f3-45b1-9d0e-f549b738224b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:15.780087 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-afc90ec1-30f3-45b1-9d0e-f549b738224b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:15.780087 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-afc90ec1-30f3-45b1-9d0e-f549b738224b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:15.780087 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-afc90ec1-30f3-45b1-9d0e-f549b738224b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:15.834096 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-2f41d51c-576f-4375-a489-a15575876c50 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590754 Jul 12 14:41:15.834739 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 126/265] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Jul 12 14:41:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:41:15.845148 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-93bb3cc7-1801-436e-a8ee-e7c3f05873d2 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:15.845964 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-93bb3cc7-1801-436e-a8ee-e7c3f05873d2 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:15.922308 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-93bb3cc7-1801-436e-a8ee-e7c3f05873d2 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:15.936445 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-93bb3cc7-1801-436e-a8ee-e7c3f05873d2 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1257 microversion: 2.1 time: 0.095713 Jul 12 14:41:15.940315 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 127/266] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:15 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1257 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:41:15.951727 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-afc90ec1-30f3-45b1-9d0e-f549b738224b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:15.961995 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-afc90ec1-30f3-45b1-9d0e-f549b738224b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.195043 Jul 12 14:41:15.962891 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 140/267] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:15 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:41:16.966003 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-1f3e3556-3b55-470a-938f-2ae7f15c51a1 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:16.966003 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-1f3e3556-3b55-470a-938f-2ae7f15c51a1 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:16.966003 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1f3e3556-3b55-470a-938f-2ae7f15c51a1 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:16.966003 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1f3e3556-3b55-470a-938f-2ae7f15c51a1 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:16.966688 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1f3e3556-3b55-470a-938f-2ae7f15c51a1 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:16.966688 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1f3e3556-3b55-470a-938f-2ae7f15c51a1 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:16.978803 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-cb7f9d76-a6c2-463e-81fd-054bdf8e8c8d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:16.979419 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-cb7f9d76-a6c2-463e-81fd-054bdf8e8c8d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:16.985650 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-cb7f9d76-a6c2-463e-81fd-054bdf8e8c8d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:16.986100 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-cb7f9d76-a6c2-463e-81fd-054bdf8e8c8d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:16.986880 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-cb7f9d76-a6c2-463e-81fd-054bdf8e8c8d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:16.988009 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-cb7f9d76-a6c2-463e-81fd-054bdf8e8c8d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:17.032126 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-1f3e3556-3b55-470a-938f-2ae7f15c51a1 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:17.040417 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-1f3e3556-3b55-470a-938f-2ae7f15c51a1 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1261 microversion: 2.1 time: 0.088348 Jul 12 14:41:17.041172 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 128/268] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:16 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1261 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:17.127752 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-cb7f9d76-a6c2-463e-81fd-054bdf8e8c8d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:17.136034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-cb7f9d76-a6c2-463e-81fd-054bdf8e8c8d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.161095 Jul 12 14:41:17.136583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 141/269] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:16 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:41:18.057416 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-12b19ab8-0b7a-45c0-9a3e-b98811d0fc71 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:18.058034 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-12b19ab8-0b7a-45c0-9a3e-b98811d0fc71 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:18.064581 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-12b19ab8-0b7a-45c0-9a3e-b98811d0fc71 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:18.065035 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-12b19ab8-0b7a-45c0-9a3e-b98811d0fc71 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:18.065913 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-12b19ab8-0b7a-45c0-9a3e-b98811d0fc71 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:18.066355 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-12b19ab8-0b7a-45c0-9a3e-b98811d0fc71 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:18.133885 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-12b19ab8-0b7a-45c0-9a3e-b98811d0fc71 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:18.142570 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-12b19ab8-0b7a-45c0-9a3e-b98811d0fc71 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1309 microversion: 2.1 time: 0.089456 Jul 12 14:41:18.143142 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 129/270] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:18 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1309 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:18.157779 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-7502ccdd-feaf-4d67-b5dd-daabb441fefd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:18.158495 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-7502ccdd-feaf-4d67-b5dd-daabb441fefd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:18.165336 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7502ccdd-feaf-4d67-b5dd-daabb441fefd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:18.167583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7502ccdd-feaf-4d67-b5dd-daabb441fefd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:18.167583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7502ccdd-feaf-4d67-b5dd-daabb441fefd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:18.167583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7502ccdd-feaf-4d67-b5dd-daabb441fefd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:18.300667 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7502ccdd-feaf-4d67-b5dd-daabb441fefd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:18.311389 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-7502ccdd-feaf-4d67-b5dd-daabb441fefd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.160477 Jul 12 14:41:18.311389 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 142/271] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:18 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:19.159675 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-364d8c79-c0db-4e75-b1d4-4b3b761204bf tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:19.160284 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-364d8c79-c0db-4e75-b1d4-4b3b761204bf tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:19.167310 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-364d8c79-c0db-4e75-b1d4-4b3b761204bf tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:19.167757 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-364d8c79-c0db-4e75-b1d4-4b3b761204bf tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:19.168514 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-364d8c79-c0db-4e75-b1d4-4b3b761204bf tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:19.168951 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-364d8c79-c0db-4e75-b1d4-4b3b761204bf tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:19.229824 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-364d8c79-c0db-4e75-b1d4-4b3b761204bf tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:19.237229 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-364d8c79-c0db-4e75-b1d4-4b3b761204bf tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1317 microversion: 2.1 time: 0.081350 Jul 12 14:41:19.237791 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 130/272] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:19 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1317 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:19.325675 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c4635bed-8545-40d2-b2ab-bd978ab1362e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:19.326355 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-c4635bed-8545-40d2-b2ab-bd978ab1362e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:19.332398 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c4635bed-8545-40d2-b2ab-bd978ab1362e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:19.332844 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c4635bed-8545-40d2-b2ab-bd978ab1362e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:19.333629 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c4635bed-8545-40d2-b2ab-bd978ab1362e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:19.334067 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c4635bed-8545-40d2-b2ab-bd978ab1362e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:19.477192 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c4635bed-8545-40d2-b2ab-bd978ab1362e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:19.484559 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-c4635bed-8545-40d2-b2ab-bd978ab1362e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.162676 Jul 12 14:41:19.485125 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 143/273] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:19 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:20.255060 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-2cbbc168-3003-44b4-a93f-8aa457bbe090 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:20.255778 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-2cbbc168-3003-44b4-a93f-8aa457bbe090 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:20.262927 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2cbbc168-3003-44b4-a93f-8aa457bbe090 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:20.263371 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2cbbc168-3003-44b4-a93f-8aa457bbe090 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:20.264175 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2cbbc168-3003-44b4-a93f-8aa457bbe090 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:20.264610 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2cbbc168-3003-44b4-a93f-8aa457bbe090 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:20.324746 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-2cbbc168-3003-44b4-a93f-8aa457bbe090 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:20.332295 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-2cbbc168-3003-44b4-a93f-8aa457bbe090 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1317 microversion: 2.1 time: 0.081079 Jul 12 14:41:20.332862 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 131/274] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:20 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1317 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:20.501435 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d547c2f3-e82d-4b99-aebd-0dc1143e05e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:20.502170 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-d547c2f3-e82d-4b99-aebd-0dc1143e05e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:20.508129 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d547c2f3-e82d-4b99-aebd-0dc1143e05e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:20.509730 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d547c2f3-e82d-4b99-aebd-0dc1143e05e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:20.509855 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d547c2f3-e82d-4b99-aebd-0dc1143e05e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:20.510211 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d547c2f3-e82d-4b99-aebd-0dc1143e05e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:20.646649 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d547c2f3-e82d-4b99-aebd-0dc1143e05e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:20.654818 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-d547c2f3-e82d-4b99-aebd-0dc1143e05e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.157261 Jul 12 14:41:20.655388 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 144/275] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:20 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:21.348680 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-44b49fc5-6328-4076-9d8c-94aace39a6d4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:21.349353 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-44b49fc5-6328-4076-9d8c-94aace39a6d4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:21.356229 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-44b49fc5-6328-4076-9d8c-94aace39a6d4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:21.356678 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-44b49fc5-6328-4076-9d8c-94aace39a6d4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:21.357469 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-44b49fc5-6328-4076-9d8c-94aace39a6d4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:21.357905 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-44b49fc5-6328-4076-9d8c-94aace39a6d4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:21.438572 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-44b49fc5-6328-4076-9d8c-94aace39a6d4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:21.446190 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-44b49fc5-6328-4076-9d8c-94aace39a6d4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1327 microversion: 2.1 time: 0.101069 Jul 12 14:41:21.446773 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 132/276] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:21 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:41:21.672766 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-f58bbf86-c1c6-497f-8da6-f8142cd665cb tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:21.673651 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-f58bbf86-c1c6-497f-8da6-f8142cd665cb tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:21.680393 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f58bbf86-c1c6-497f-8da6-f8142cd665cb tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:21.680995 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f58bbf86-c1c6-497f-8da6-f8142cd665cb tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:21.684104 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f58bbf86-c1c6-497f-8da6-f8142cd665cb tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:21.684104 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f58bbf86-c1c6-497f-8da6-f8142cd665cb tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:21.885942 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-f58bbf86-c1c6-497f-8da6-f8142cd665cb tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:21.896310 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-f58bbf86-c1c6-497f-8da6-f8142cd665cb tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.228183 Jul 12 14:41:21.896895 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 145/277] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:21 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:22.463795 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0636ea70-014b-4671-976f-0aea3bf906b0 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:22.464508 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-0636ea70-014b-4671-976f-0aea3bf906b0 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:22.467987 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:22.471555 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0636ea70-014b-4671-976f-0aea3bf906b0 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:22.472066 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0636ea70-014b-4671-976f-0aea3bf906b0 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:22.472845 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0636ea70-014b-4671-976f-0aea3bf906b0 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:22.473314 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0636ea70-014b-4671-976f-0aea3bf906b0 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:22.711395 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-0636ea70-014b-4671-976f-0aea3bf906b0 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:22.723053 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-0636ea70-014b-4671-976f-0aea3bf906b0 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1357 microversion: 2.1 time: 0.262861 Jul 12 14:41:22.724550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 133/278] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:22 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1357 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:22.913722 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-5803257a-7ddc-4c62-9e3f-85fe1d827191 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:22.914327 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-5803257a-7ddc-4c62-9e3f-85fe1d827191 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:22.921541 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5803257a-7ddc-4c62-9e3f-85fe1d827191 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:22.922218 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5803257a-7ddc-4c62-9e3f-85fe1d827191 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:22.923405 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5803257a-7ddc-4c62-9e3f-85fe1d827191 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:22.924084 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5803257a-7ddc-4c62-9e3f-85fe1d827191 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:23.222239 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-5803257a-7ddc-4c62-9e3f-85fe1d827191 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:23.237403 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-5803257a-7ddc-4c62-9e3f-85fe1d827191 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.327549 Jul 12 14:41:23.238157 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 146/279] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:22 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:23.438452 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-e0a19aa1-1ac4-4feb-adb5-62fd241e2047 req-e6dccad1-2c18-446d-b391-2bfa46f18c85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84cf1792-70fc-4b57-a953-74848c1eb8ca", "tag": "158072fd-c24f-4080-926d-9613cf2adbd5"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:41:23.456398 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-e0a19aa1-1ac4-4feb-adb5-62fd241e2047 req-e6dccad1-2c18-446d-b391-2bfa46f18c85 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:23.458347 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-e0a19aa1-1ac4-4feb-adb5-62fd241e2047 req-e6dccad1-2c18-446d-b391-2bfa46f18c85 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:23.506835 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-e0a19aa1-1ac4-4feb-adb5-62fd241e2047 req-e6dccad1-2c18-446d-b391-2bfa46f18c85 service nova] Creating event network-changed:158072fd-c24f-4080-926d-9613cf2adbd5 for instance 84cf1792-70fc-4b57-a953-74848c1eb8ca on hv-cinder-82002 Jul 12 14:41:23.526588 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-e0a19aa1-1ac4-4feb-adb5-62fd241e2047 req-e6dccad1-2c18-446d-b391-2bfa46f18c85 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099396 Jul 12 14:41:23.532021 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 134/280] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:41:23.740408 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-a19fd637-337c-4572-861a-7a53abbca160 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:23.741031 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-a19fd637-337c-4572-861a-7a53abbca160 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:23.750157 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a19fd637-337c-4572-861a-7a53abbca160 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:23.750796 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a19fd637-337c-4572-861a-7a53abbca160 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:23.751604 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a19fd637-337c-4572-861a-7a53abbca160 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:23.752037 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a19fd637-337c-4572-861a-7a53abbca160 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:23.898142 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-a19fd637-337c-4572-861a-7a53abbca160 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:23.907859 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-a19fd637-337c-4572-861a-7a53abbca160 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1357 microversion: 2.1 time: 0.171376 Jul 12 14:41:23.908755 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 147/281] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:23 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:24.256007 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-580cc350-a405-44a1-b90f-97d105f04e66 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:24.256697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-580cc350-a405-44a1-b90f-97d105f04e66 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:24.263395 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-580cc350-a405-44a1-b90f-97d105f04e66 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:24.263860 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-580cc350-a405-44a1-b90f-97d105f04e66 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:24.264609 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-580cc350-a405-44a1-b90f-97d105f04e66 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:24.265043 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-580cc350-a405-44a1-b90f-97d105f04e66 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:24.414896 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-580cc350-a405-44a1-b90f-97d105f04e66 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:24.422941 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-580cc350-a405-44a1-b90f-97d105f04e66 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.170989 Jul 12 14:41:24.423667 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 135/282] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:24 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:24.925809 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-10aa0e42-ca7b-44c4-9b8d-b736cfb8b565 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:24.926452 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-10aa0e42-ca7b-44c4-9b8d-b736cfb8b565 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:24.933071 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-10aa0e42-ca7b-44c4-9b8d-b736cfb8b565 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:24.933542 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-10aa0e42-ca7b-44c4-9b8d-b736cfb8b565 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:24.934300 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-10aa0e42-ca7b-44c4-9b8d-b736cfb8b565 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:24.934737 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-10aa0e42-ca7b-44c4-9b8d-b736cfb8b565 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:25.046622 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell0:SELECT=4 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:25.114948 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-10aa0e42-ca7b-44c4-9b8d-b736cfb8b565 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:25.141114 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-10aa0e42-ca7b-44c4-9b8d-b736cfb8b565 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1357 microversion: 2.1 time: 0.218986 Jul 12 14:41:25.153521 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 148/283] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:24 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1357 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:25.441758 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-a6dfab58-03dc-428b-b80e-87a2e4f23812 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:25.442375 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-a6dfab58-03dc-428b-b80e-87a2e4f23812 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:25.448793 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a6dfab58-03dc-428b-b80e-87a2e4f23812 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:25.449280 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a6dfab58-03dc-428b-b80e-87a2e4f23812 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:25.450051 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a6dfab58-03dc-428b-b80e-87a2e4f23812 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:25.450489 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a6dfab58-03dc-428b-b80e-87a2e4f23812 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:25.592022 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-a6dfab58-03dc-428b-b80e-87a2e4f23812 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:25.600904 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-a6dfab58-03dc-428b-b80e-87a2e4f23812 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.163076 Jul 12 14:41:25.601513 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 136/284] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:25 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:26.168133 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-3cde7b97-337e-4e62-800b-3dc30b959c1e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:26.168738 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-3cde7b97-337e-4e62-800b-3dc30b959c1e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:26.175305 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3cde7b97-337e-4e62-800b-3dc30b959c1e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:26.176207 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3cde7b97-337e-4e62-800b-3dc30b959c1e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:26.177132 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3cde7b97-337e-4e62-800b-3dc30b959c1e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:26.177728 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3cde7b97-337e-4e62-800b-3dc30b959c1e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:26.322680 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-3cde7b97-337e-4e62-800b-3dc30b959c1e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:26.331465 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-3cde7b97-337e-4e62-800b-3dc30b959c1e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1357 microversion: 2.1 time: 0.167165 Jul 12 14:41:26.333190 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 149/285] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:26 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:26.618363 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-4147ae9b-8782-4bf1-8705-3b7fd74d0df4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:26.618975 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-4147ae9b-8782-4bf1-8705-3b7fd74d0df4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:26.621215 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell0:SELECT=2 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:26.621961 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell0:SELECT=8 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:26.627204 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4147ae9b-8782-4bf1-8705-3b7fd74d0df4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:26.627654 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4147ae9b-8782-4bf1-8705-3b7fd74d0df4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:26.628590 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4147ae9b-8782-4bf1-8705-3b7fd74d0df4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:26.629030 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4147ae9b-8782-4bf1-8705-3b7fd74d0df4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:26.771611 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-4147ae9b-8782-4bf1-8705-3b7fd74d0df4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:26.779637 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-4147ae9b-8782-4bf1-8705-3b7fd74d0df4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.165193 Jul 12 14:41:26.780385 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 137/286] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:26 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:27.348086 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-bf10ce2b-6533-4072-a01a-fb322d7a4273 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:27.349439 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-bf10ce2b-6533-4072-a01a-fb322d7a4273 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:27.355566 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:27.357366 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bf10ce2b-6533-4072-a01a-fb322d7a4273 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:27.357909 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bf10ce2b-6533-4072-a01a-fb322d7a4273 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:27.358837 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bf10ce2b-6533-4072-a01a-fb322d7a4273 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:27.359510 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bf10ce2b-6533-4072-a01a-fb322d7a4273 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:27.508281 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-bf10ce2b-6533-4072-a01a-fb322d7a4273 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:27.516375 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-bf10ce2b-6533-4072-a01a-fb322d7a4273 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1357 microversion: 2.1 time: 0.172220 Jul 12 14:41:27.517192 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 150/287] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:27 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:27.798660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-3c5d596e-13a6-4bba-921e-e3e78d7bf4c8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:27.799320 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-3c5d596e-13a6-4bba-921e-e3e78d7bf4c8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:27.807493 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3c5d596e-13a6-4bba-921e-e3e78d7bf4c8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:27.807955 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3c5d596e-13a6-4bba-921e-e3e78d7bf4c8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:27.808927 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3c5d596e-13a6-4bba-921e-e3e78d7bf4c8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:27.809391 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3c5d596e-13a6-4bba-921e-e3e78d7bf4c8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:27.944477 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-3c5d596e-13a6-4bba-921e-e3e78d7bf4c8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:27.953130 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-3c5d596e-13a6-4bba-921e-e3e78d7bf4c8 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.159176 Jul 12 14:41:27.954095 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 138/288] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:27 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:28.534846 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-faeafed8-c3ca-4f31-87f8-20807fdf1fed tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:28.536403 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-faeafed8-c3ca-4f31-87f8-20807fdf1fed tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:28.542439 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-faeafed8-c3ca-4f31-87f8-20807fdf1fed tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:28.542924 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-faeafed8-c3ca-4f31-87f8-20807fdf1fed tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:28.543690 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-faeafed8-c3ca-4f31-87f8-20807fdf1fed tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:28.544186 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-faeafed8-c3ca-4f31-87f8-20807fdf1fed tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:28.723006 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-faeafed8-c3ca-4f31-87f8-20807fdf1fed tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:28.732075 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-faeafed8-c3ca-4f31-87f8-20807fdf1fed tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1357 microversion: 2.1 time: 0.200922 Jul 12 14:41:28.732645 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 151/289] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:28 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1357 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:28.978500 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-fcac85de-a11b-4b28-a3b7-872bb3de940d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:28.979105 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-fcac85de-a11b-4b28-a3b7-872bb3de940d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:28.985670 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fcac85de-a11b-4b28-a3b7-872bb3de940d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:28.986117 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fcac85de-a11b-4b28-a3b7-872bb3de940d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:28.986873 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fcac85de-a11b-4b28-a3b7-872bb3de940d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:28.987303 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fcac85de-a11b-4b28-a3b7-872bb3de940d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:29.124504 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-fcac85de-a11b-4b28-a3b7-872bb3de940d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:29.136816 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-fcac85de-a11b-4b28-a3b7-872bb3de940d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.162388 Jul 12 14:41:29.144153 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 139/290] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:28 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:29.750560 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-285840fd-872c-4c44-aed7-fbb47f2036ca tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:29.751351 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-285840fd-872c-4c44-aed7-fbb47f2036ca tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:29.757684 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-285840fd-872c-4c44-aed7-fbb47f2036ca tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:29.758325 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-285840fd-872c-4c44-aed7-fbb47f2036ca tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:29.759471 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-285840fd-872c-4c44-aed7-fbb47f2036ca tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:29.759901 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-285840fd-872c-4c44-aed7-fbb47f2036ca tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:29.945077 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-285840fd-872c-4c44-aed7-fbb47f2036ca tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:29.953986 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-285840fd-872c-4c44-aed7-fbb47f2036ca tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1357 microversion: 2.1 time: 0.207586 Jul 12 14:41:29.962839 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 152/291] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:29 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1357 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:30.157673 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-eabc6268-2853-4c6c-bb2b-66ce559e70e5 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:30.159120 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-eabc6268-2853-4c6c-bb2b-66ce559e70e5 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:30.166880 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-eabc6268-2853-4c6c-bb2b-66ce559e70e5 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:30.167344 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-eabc6268-2853-4c6c-bb2b-66ce559e70e5 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:30.168121 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-eabc6268-2853-4c6c-bb2b-66ce559e70e5 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:30.168731 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-eabc6268-2853-4c6c-bb2b-66ce559e70e5 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:30.305578 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-eabc6268-2853-4c6c-bb2b-66ce559e70e5 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:30.317666 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-eabc6268-2853-4c6c-bb2b-66ce559e70e5 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.165110 Jul 12 14:41:30.321652 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 140/292] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:30 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:41:30.977713 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d1043c14-d66b-49e3-8004-e6c6a5b10548 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:30.978350 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-d1043c14-d66b-49e3-8004-e6c6a5b10548 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:30.984563 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d1043c14-d66b-49e3-8004-e6c6a5b10548 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:30.985011 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d1043c14-d66b-49e3-8004-e6c6a5b10548 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:30.985812 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d1043c14-d66b-49e3-8004-e6c6a5b10548 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:30.986390 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d1043c14-d66b-49e3-8004-e6c6a5b10548 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:31.124187 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d1043c14-d66b-49e3-8004-e6c6a5b10548 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:31.132046 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-d1043c14-d66b-49e3-8004-e6c6a5b10548 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1357 microversion: 2.1 time: 0.158142 Jul 12 14:41:31.135805 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 153/293] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:30 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:31.337287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-b1a9f274-8362-4cc4-a53b-c99c0899dd9b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:31.337957 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-b1a9f274-8362-4cc4-a53b-c99c0899dd9b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:31.344648 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b1a9f274-8362-4cc4-a53b-c99c0899dd9b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:31.345101 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b1a9f274-8362-4cc4-a53b-c99c0899dd9b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:31.345908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b1a9f274-8362-4cc4-a53b-c99c0899dd9b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:31.346393 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b1a9f274-8362-4cc4-a53b-c99c0899dd9b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:31.512542 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-b1a9f274-8362-4cc4-a53b-c99c0899dd9b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:31.520318 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-b1a9f274-8362-4cc4-a53b-c99c0899dd9b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.186947 Jul 12 14:41:31.521100 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 141/294] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:31 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:32.149224 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c2fe9a2a-2d41-4220-a169-8255391c3381 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:32.150366 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-c2fe9a2a-2d41-4220-a169-8255391c3381 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:32.156602 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c2fe9a2a-2d41-4220-a169-8255391c3381 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:32.157046 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c2fe9a2a-2d41-4220-a169-8255391c3381 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:32.157831 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c2fe9a2a-2d41-4220-a169-8255391c3381 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:32.158304 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c2fe9a2a-2d41-4220-a169-8255391c3381 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:32.282165 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c2fe9a2a-2d41-4220-a169-8255391c3381 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:32.289522 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-c2fe9a2a-2d41-4220-a169-8255391c3381 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1357 microversion: 2.1 time: 0.144108 Jul 12 14:41:32.290082 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 154/295] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:32 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1357 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:32.537379 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0ea7b571-63ce-45e8-bd63-feef79366b4d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:32.538559 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-0ea7b571-63ce-45e8-bd63-feef79366b4d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:32.544174 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0ea7b571-63ce-45e8-bd63-feef79366b4d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:32.544627 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0ea7b571-63ce-45e8-bd63-feef79366b4d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:32.545408 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0ea7b571-63ce-45e8-bd63-feef79366b4d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:32.545842 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0ea7b571-63ce-45e8-bd63-feef79366b4d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:32.673946 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-0ea7b571-63ce-45e8-bd63-feef79366b4d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:32.681482 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-0ea7b571-63ce-45e8-bd63-feef79366b4d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.147892 Jul 12 14:41:32.682065 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 142/296] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:32 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:33.307580 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-df8859bb-3e28-45a5-992f-55c2c3379fa0 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:33.308112 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-df8859bb-3e28-45a5-992f-55c2c3379fa0 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:33.314111 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-df8859bb-3e28-45a5-992f-55c2c3379fa0 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:33.314551 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-df8859bb-3e28-45a5-992f-55c2c3379fa0 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:33.315295 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-df8859bb-3e28-45a5-992f-55c2c3379fa0 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:33.315727 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-df8859bb-3e28-45a5-992f-55c2c3379fa0 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:33.450424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-df8859bb-3e28-45a5-992f-55c2c3379fa0 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:33.457969 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-df8859bb-3e28-45a5-992f-55c2c3379fa0 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1357 microversion: 2.1 time: 0.155161 Jul 12 14:41:33.458615 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 155/297] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:33 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:33.698320 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-66ac7b52-31ea-4043-9695-8cdbad479b36 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:33.698962 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-66ac7b52-31ea-4043-9695-8cdbad479b36 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:33.705389 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-66ac7b52-31ea-4043-9695-8cdbad479b36 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:33.705846 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-66ac7b52-31ea-4043-9695-8cdbad479b36 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:33.706602 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-66ac7b52-31ea-4043-9695-8cdbad479b36 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:33.707035 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-66ac7b52-31ea-4043-9695-8cdbad479b36 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:33.838840 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-66ac7b52-31ea-4043-9695-8cdbad479b36 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:33.846071 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-66ac7b52-31ea-4043-9695-8cdbad479b36 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.151603 Jul 12 14:41:33.846637 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 143/298] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:33 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:34.473710 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-98794ca5-db02-42da-ac05-aaa69453a20b tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:34.474366 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-98794ca5-db02-42da-ac05-aaa69453a20b tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:34.480430 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-98794ca5-db02-42da-ac05-aaa69453a20b tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:34.480874 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-98794ca5-db02-42da-ac05-aaa69453a20b tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:34.481650 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-98794ca5-db02-42da-ac05-aaa69453a20b tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:34.482079 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-98794ca5-db02-42da-ac05-aaa69453a20b tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:34.485990 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=100 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:34.608356 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-98794ca5-db02-42da-ac05-aaa69453a20b tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:34.616137 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-98794ca5-db02-42da-ac05-aaa69453a20b tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1357 microversion: 2.1 time: 0.146141 Jul 12 14:41:34.616699 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 156/299] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:34 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:34.863831 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-372b6b13-1cdc-4a7f-946a-c6a61a3ebffd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:34.867033 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-372b6b13-1cdc-4a7f-946a-c6a61a3ebffd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:34.876334 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-372b6b13-1cdc-4a7f-946a-c6a61a3ebffd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:34.877009 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-372b6b13-1cdc-4a7f-946a-c6a61a3ebffd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:34.878196 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-372b6b13-1cdc-4a7f-946a-c6a61a3ebffd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:34.878642 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-372b6b13-1cdc-4a7f-946a-c6a61a3ebffd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:35.336058 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-372b6b13-1cdc-4a7f-946a-c6a61a3ebffd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:35.340121 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=100 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:35.344484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-372b6b13-1cdc-4a7f-946a-c6a61a3ebffd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.484548 Jul 12 14:41:35.345048 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 144/300] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:34 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:35.633571 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-ce6a725a-d4f3-407f-891e-8b1dcf829dec tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:35.634264 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-ce6a725a-d4f3-407f-891e-8b1dcf829dec tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:35.640350 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ce6a725a-d4f3-407f-891e-8b1dcf829dec tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:35.640799 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ce6a725a-d4f3-407f-891e-8b1dcf829dec tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:35.641613 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ce6a725a-d4f3-407f-891e-8b1dcf829dec tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:35.642042 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ce6a725a-d4f3-407f-891e-8b1dcf829dec tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:35.771231 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-ce6a725a-d4f3-407f-891e-8b1dcf829dec tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:35.779148 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-ce6a725a-d4f3-407f-891e-8b1dcf829dec tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1357 microversion: 2.1 time: 0.149385 Jul 12 14:41:35.779700 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 157/301] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:35 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:36.362090 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-9d866a80-9d32-4178-8a36-74b6556afc29 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:36.362700 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-9d866a80-9d32-4178-8a36-74b6556afc29 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:36.369633 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9d866a80-9d32-4178-8a36-74b6556afc29 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:36.370341 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9d866a80-9d32-4178-8a36-74b6556afc29 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:36.371095 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9d866a80-9d32-4178-8a36-74b6556afc29 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:36.371523 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9d866a80-9d32-4178-8a36-74b6556afc29 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:36.500517 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-9d866a80-9d32-4178-8a36-74b6556afc29 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:36.507964 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-9d866a80-9d32-4178-8a36-74b6556afc29 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.149742 Jul 12 14:41:36.508538 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 145/302] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:36 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:36.797854 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c5b056f0-36a5-4416-86a1-b29f573d9188 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:36.798772 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-c5b056f0-36a5-4416-86a1-b29f573d9188 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:36.804981 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c5b056f0-36a5-4416-86a1-b29f573d9188 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:36.808137 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c5b056f0-36a5-4416-86a1-b29f573d9188 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:36.808137 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c5b056f0-36a5-4416-86a1-b29f573d9188 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:36.808137 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c5b056f0-36a5-4416-86a1-b29f573d9188 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:36.946696 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c5b056f0-36a5-4416-86a1-b29f573d9188 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:36.954106 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-c5b056f0-36a5-4416-86a1-b29f573d9188 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1357 microversion: 2.1 time: 0.162184 Jul 12 14:41:36.954668 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 158/303] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:36 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:37.525100 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-d8d0bc6b-6e09-4804-9185-c71bd35c41be tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:37.525740 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-d8d0bc6b-6e09-4804-9185-c71bd35c41be tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:37.532595 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d8d0bc6b-6e09-4804-9185-c71bd35c41be tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:37.533046 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d8d0bc6b-6e09-4804-9185-c71bd35c41be tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:37.535819 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d8d0bc6b-6e09-4804-9185-c71bd35c41be tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:37.535819 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d8d0bc6b-6e09-4804-9185-c71bd35c41be tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:37.666282 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-d8d0bc6b-6e09-4804-9185-c71bd35c41be tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:37.673983 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-d8d0bc6b-6e09-4804-9185-c71bd35c41be tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.152677 Jul 12 14:41:37.674548 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 146/304] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:37 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:37.971053 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-9191efd8-e13b-4c3c-a217-ea08c782f0fd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:37.971693 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-9191efd8-e13b-4c3c-a217-ea08c782f0fd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:37.978175 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9191efd8-e13b-4c3c-a217-ea08c782f0fd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:37.978612 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9191efd8-e13b-4c3c-a217-ea08c782f0fd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:37.979353 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9191efd8-e13b-4c3c-a217-ea08c782f0fd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:37.979782 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9191efd8-e13b-4c3c-a217-ea08c782f0fd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:38.106157 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-9191efd8-e13b-4c3c-a217-ea08c782f0fd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:38.113624 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-9191efd8-e13b-4c3c-a217-ea08c782f0fd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1357 microversion: 2.1 time: 0.146351 Jul 12 14:41:38.114438 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 159/305] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:37 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:38.691346 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-365eb07f-894f-4d64-8f1f-f2b7ce87496c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:38.691978 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-365eb07f-894f-4d64-8f1f-f2b7ce87496c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:38.698929 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-365eb07f-894f-4d64-8f1f-f2b7ce87496c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:38.699375 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-365eb07f-894f-4d64-8f1f-f2b7ce87496c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:38.700126 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-365eb07f-894f-4d64-8f1f-f2b7ce87496c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:38.700559 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-365eb07f-894f-4d64-8f1f-f2b7ce87496c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:38.830360 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-365eb07f-894f-4d64-8f1f-f2b7ce87496c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:38.837779 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-365eb07f-894f-4d64-8f1f-f2b7ce87496c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.150230 Jul 12 14:41:38.838344 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 147/306] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:38 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:39.130054 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-34732b02-1c5c-4202-afa2-2b413d0c2319 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:39.130605 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-34732b02-1c5c-4202-afa2-2b413d0c2319 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:39.137247 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-34732b02-1c5c-4202-afa2-2b413d0c2319 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:39.137693 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-34732b02-1c5c-4202-afa2-2b413d0c2319 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:39.138450 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-34732b02-1c5c-4202-afa2-2b413d0c2319 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:39.138885 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-34732b02-1c5c-4202-afa2-2b413d0c2319 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:39.268367 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-34732b02-1c5c-4202-afa2-2b413d0c2319 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:39.275802 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-34732b02-1c5c-4202-afa2-2b413d0c2319 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1357 microversion: 2.1 time: 0.149651 Jul 12 14:41:39.276354 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 160/307] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:39 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:39.855154 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-79a01ed2-bb45-4240-ae34-3b92ace7fe17 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:39.855671 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-79a01ed2-bb45-4240-ae34-3b92ace7fe17 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:39.862276 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-79a01ed2-bb45-4240-ae34-3b92ace7fe17 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:39.862723 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-79a01ed2-bb45-4240-ae34-3b92ace7fe17 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:39.863513 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-79a01ed2-bb45-4240-ae34-3b92ace7fe17 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:39.863951 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-79a01ed2-bb45-4240-ae34-3b92ace7fe17 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:39.993767 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-79a01ed2-bb45-4240-ae34-3b92ace7fe17 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:40.001433 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-79a01ed2-bb45-4240-ae34-3b92ace7fe17 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.150760 Jul 12 14:41:40.001999 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 148/308] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:39 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:40.295509 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-04f4e96d-379a-41ec-a1bb-a1caa23cd18a tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:40.296137 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-04f4e96d-379a-41ec-a1bb-a1caa23cd18a tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:40.302023 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-04f4e96d-379a-41ec-a1bb-a1caa23cd18a tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:40.306590 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-04f4e96d-379a-41ec-a1bb-a1caa23cd18a tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:40.306590 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-04f4e96d-379a-41ec-a1bb-a1caa23cd18a tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:40.306590 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-04f4e96d-379a-41ec-a1bb-a1caa23cd18a tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:40.427468 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-04f4e96d-379a-41ec-a1bb-a1caa23cd18a tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:40.435510 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-04f4e96d-379a-41ec-a1bb-a1caa23cd18a tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1357 microversion: 2.1 time: 0.143802 Jul 12 14:41:40.436096 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 161/309] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:40 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1357 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:41.019063 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0d67cabe-598d-4f02-b4c8-550a8b071578 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:41.019676 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-0d67cabe-598d-4f02-b4c8-550a8b071578 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:41.026883 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0d67cabe-598d-4f02-b4c8-550a8b071578 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:41.027338 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0d67cabe-598d-4f02-b4c8-550a8b071578 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:41.028154 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0d67cabe-598d-4f02-b4c8-550a8b071578 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:41.028593 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0d67cabe-598d-4f02-b4c8-550a8b071578 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:41.162691 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-0d67cabe-598d-4f02-b4c8-550a8b071578 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:41.170295 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-0d67cabe-598d-4f02-b4c8-550a8b071578 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.155169 Jul 12 14:41:41.174874 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 149/310] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:41 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:41.451639 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-945c8023-6eef-4e09-80ff-bedb06266cfb tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:41.452254 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-945c8023-6eef-4e09-80ff-bedb06266cfb tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:41.458601 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-945c8023-6eef-4e09-80ff-bedb06266cfb tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:41.459051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-945c8023-6eef-4e09-80ff-bedb06266cfb tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:41.459946 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-945c8023-6eef-4e09-80ff-bedb06266cfb tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:41.460385 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-945c8023-6eef-4e09-80ff-bedb06266cfb tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:41.593390 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-945c8023-6eef-4e09-80ff-bedb06266cfb tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:41.601296 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-945c8023-6eef-4e09-80ff-bedb06266cfb tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1357 microversion: 2.1 time: 0.153333 Jul 12 14:41:41.601960 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 162/311] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:41 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:42.187389 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-fbd4bee9-36f0-498a-a101-d051a6f276b1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:42.188124 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-fbd4bee9-36f0-498a-a101-d051a6f276b1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:42.194874 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fbd4bee9-36f0-498a-a101-d051a6f276b1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:42.195319 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fbd4bee9-36f0-498a-a101-d051a6f276b1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:42.198930 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fbd4bee9-36f0-498a-a101-d051a6f276b1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:42.198930 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fbd4bee9-36f0-498a-a101-d051a6f276b1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:42.323926 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-fbd4bee9-36f0-498a-a101-d051a6f276b1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:42.331366 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-fbd4bee9-36f0-498a-a101-d051a6f276b1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1502 microversion: 2.1 time: 0.148092 Jul 12 14:41:42.331930 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 150/312] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:42 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1502 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:42.351531 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-ccc0ebaa-abb8-43b2-90c1-af0ce0afc68a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3605aec9-0ec0-4bc4-abdb-6106b2fb7c51"}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:41:42.352657 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-ccc0ebaa-abb8-43b2-90c1-af0ce0afc68a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:42.358754 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ccc0ebaa-abb8-43b2-90c1-af0ce0afc68a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:42.359228 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ccc0ebaa-abb8-43b2-90c1-af0ce0afc68a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:42.359993 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ccc0ebaa-abb8-43b2-90c1-af0ce0afc68a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:42.360419 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ccc0ebaa-abb8-43b2-90c1-af0ce0afc68a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:42.386629 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.wsgi [None req-ccc0ebaa-abb8-43b2-90c1-af0ce0afc68a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] HTTP exception thrown: Cannot 'attach_volume' instance 2e8ad66c-747a-4266-9452-a45bfeefa6c7 while it is in vm_state rescued Jul 12 14:41:42.388369 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-ccc0ebaa-abb8-43b2-90c1-af0ce0afc68a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Request method failure captured: Jul 12 14:41:42.388369 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: POST /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7/os-volume_attachments HTTP/1.1 Jul 12 14:41:42.388369 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:41:42.388369 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:41:42.388369 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:41:42.388369 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 74 Jul 12 14:41:42.388369 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:41:42.388369 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:41:42.388369 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:41:42.388369 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:41:42.388369 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYehYws4HrgGrv1QXrmsu2xWw8GXYW-BydE4l3b7e715YjEfH2g10AAcubc3F8Fua7xKtXboov3Y2Z32aGrkzrkDds152RTIhjLssnjoz683AGXZ-ffmMw8OOKRJ4-u7WEcb8UqTTsJ21R318wN3uwczHyiupKx-Uh53TY_6T4OsmzU Jul 12 14:41:42.388369 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:41:42.388369 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:41:42.388369 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:41:42.388369 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:41:42.388369 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:41:42.388369 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:41:42.388369 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: fe2b01873d92453599763e5523a862f8 Jul 12 14:41:42.388369 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-241601666 Jul 12 14:41:42.388369 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:41:42.388369 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:41:42.389695 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fe2b01873d92453599763e5523a862f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fe2b01873d92453599763e5523a862f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fe2b01873d92453599763e5523a862f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fe2b01873d92453599763e5523a862f8", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:41:42.389695 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-ServerRescueNegativeTestJSON-241601666 Jul 12 14:41:42.389695 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: fe2b01873d92453599763e5523a862f8 Jul 12 14:41:42.389695 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-241601666 Jul 12 14:41:42.389695 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-ServerRescueNegativeTestJSON-241601666-project Jul 12 14:41:42.389695 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:41:42.389695 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:41:42.389695 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: 97f1b1e52a984639a504441e3701b981 Jul 12 14:41:42.389695 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-ServerRescueNegativeTestJSON-241601666-project Jul 12 14:41:42.389695 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Jul 12 14:41:42.389695 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {"volumeAttachment": {"volumeId": "3605aec9-0ec0-4bc4-abdb-6106b2fb7c51"}} Jul 12 14:41:42.389695 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: > Jul 12 14:41:42.390727 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Cannot 'attach_volume' instance 2e8ad66c-747a-4266-9452-a45bfeefa6c7 while it is in vm_state rescued Jul 12 14:41:42.390727 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'server_id': '2e8ad66c-747a-4266-9452-a45bfeefa6c7', 'body': {'volumeAttachment': {'volumeId': '3605aec9-0ec0-4bc4-abdb-6106b2fb7c51'}}} Jul 12 14:41:42.390727 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:41:42.390727 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:41:42.390727 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 14:41:42.390727 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 14:41:42.390727 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 14:41:42.390727 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 14:41:42.390727 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 12 14:41:42.390727 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 14:41:42.390727 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2e8ad66c-747a-4266-9452-a45bfeefa6c7 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 12 14:41:42.390727 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:41:42.390727 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:41:42.390727 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:41:42.390727 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:41:42.390727 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:41:42.390727 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:41:42.390727 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:41:42.390727 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:41:42.392156 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:41:42.392156 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:41:42.392156 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 14:41:42.392156 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 14:41:42.392156 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 14:41:42.392156 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 14:41:42.392156 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 14:41:42.392156 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 14:41:42.392156 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 12 14:41:42.392156 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 14:41:42.392156 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 14:41:42.392156 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 14:41:42.392156 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2e8ad66c-747a-4266-9452-a45bfeefa6c7 while it is in vm_state rescued Jul 12 14:41:42.392156 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:41:42.392156 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:41:42.392156 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:41:42.392156 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:41:42.392156 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:41:42.392156 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:41:42.394833 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:41:42.394833 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:41:42.394833 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2e8ad66c-747a-4266-9452-a45bfeefa6c7 while it is in vm_state rescued Jul 12 14:41:42.394833 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:41:42.394833 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-ccc0ebaa-abb8-43b2-90c1-af0ce0afc68a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Returning 409 to user: Cannot 'attach_volume' instance 2e8ad66c-747a-4266-9452-a45bfeefa6c7 while it is in vm_state rescued {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:41:42.394833 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-ccc0ebaa-abb8-43b2-90c1-af0ce0afc68a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "POST /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042471 Jul 12 14:41:42.394833 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 163/313] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Jul 12 14:41:42 2022] POST /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 12 14:41:42.399700 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-addf775f-7987-4f0a-92c0-f1b0914fdc33 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:41:42.400279 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-addf775f-7987-4f0a-92c0-f1b0914fdc33 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:42.406658 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-addf775f-7987-4f0a-92c0-f1b0914fdc33 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:42.407111 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-addf775f-7987-4f0a-92c0-f1b0914fdc33 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:42.407944 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-addf775f-7987-4f0a-92c0-f1b0914fdc33 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:42.408344 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-addf775f-7987-4f0a-92c0-f1b0914fdc33 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:42.622147 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-ead76eb7-7eb8-4669-bab3-9328c15ffb24 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:42.625832 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-ead76eb7-7eb8-4669-bab3-9328c15ffb24 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:42.626410 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-addf775f-7987-4f0a-92c0-f1b0914fdc33 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "POST /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7/action" status: 202 len: 0 microversion: 2.1 time: 0.230783 Jul 12 14:41:42.628412 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 151/314] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Jul 12 14:41:42 2022] POST /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 14:41:42.639278 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ed1ed40c-8ed8-4b6a-a5a6-669363c4f827 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:42.641373 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-ed1ed40c-8ed8-4b6a-a5a6-669363c4f827 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:42.643543 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ead76eb7-7eb8-4669-bab3-9328c15ffb24 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:42.644833 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ead76eb7-7eb8-4669-bab3-9328c15ffb24 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:42.646199 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ead76eb7-7eb8-4669-bab3-9328c15ffb24 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:42.649517 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ead76eb7-7eb8-4669-bab3-9328c15ffb24 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:42.651665 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ed1ed40c-8ed8-4b6a-a5a6-669363c4f827 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:42.652124 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ed1ed40c-8ed8-4b6a-a5a6-669363c4f827 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:42.652946 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ed1ed40c-8ed8-4b6a-a5a6-669363c4f827 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:42.653421 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ed1ed40c-8ed8-4b6a-a5a6-669363c4f827 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:42.894997 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ed1ed40c-8ed8-4b6a-a5a6-669363c4f827 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:42.902824 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ed1ed40c-8ed8-4b6a-a5a6-669363c4f827 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1510 microversion: 2.1 time: 0.270187 Jul 12 14:41:42.904170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 152/315] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:42 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1510 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:41:42.918056 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-ead76eb7-7eb8-4669-bab3-9328c15ffb24 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:42.928656 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-ead76eb7-7eb8-4669-bab3-9328c15ffb24 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1357 microversion: 2.1 time: 0.313495 Jul 12 14:41:42.929337 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 164/316] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:42 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1357 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:41:43.920151 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0bac9e7c-6bd5-46c3-b0bd-b0473bcbaca5 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:43.920772 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-0bac9e7c-6bd5-46c3-b0bd-b0473bcbaca5 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:43.927300 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0bac9e7c-6bd5-46c3-b0bd-b0473bcbaca5 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:43.927749 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0bac9e7c-6bd5-46c3-b0bd-b0473bcbaca5 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:43.928507 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0bac9e7c-6bd5-46c3-b0bd-b0473bcbaca5 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:43.928944 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0bac9e7c-6bd5-46c3-b0bd-b0473bcbaca5 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:43.946811 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-bca6b9fb-ca8a-40d7-8421-8b2ed44765e4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:43.947470 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-bca6b9fb-ca8a-40d7-8421-8b2ed44765e4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:43.954738 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bca6b9fb-ca8a-40d7-8421-8b2ed44765e4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:43.955305 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bca6b9fb-ca8a-40d7-8421-8b2ed44765e4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:43.956010 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bca6b9fb-ca8a-40d7-8421-8b2ed44765e4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:43.956442 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bca6b9fb-ca8a-40d7-8421-8b2ed44765e4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:44.145305 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-0bac9e7c-6bd5-46c3-b0bd-b0473bcbaca5 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:44.152894 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-0bac9e7c-6bd5-46c3-b0bd-b0473bcbaca5 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1510 microversion: 2.1 time: 0.236867 Jul 12 14:41:44.153506 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 153/317] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:43 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1510 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:44.171454 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-bca6b9fb-ca8a-40d7-8421-8b2ed44765e4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:44.178882 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-bca6b9fb-ca8a-40d7-8421-8b2ed44765e4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1357 microversion: 2.1 time: 0.236420 Jul 12 14:41:44.179430 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 165/318] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:43 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1357 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:41:45.171072 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-391e45f5-2b9d-46e4-90c8-b2029e451b34 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:45.171635 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-391e45f5-2b9d-46e4-90c8-b2029e451b34 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:45.178098 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-391e45f5-2b9d-46e4-90c8-b2029e451b34 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:45.178548 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-391e45f5-2b9d-46e4-90c8-b2029e451b34 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:45.179302 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-391e45f5-2b9d-46e4-90c8-b2029e451b34 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:45.179741 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-391e45f5-2b9d-46e4-90c8-b2029e451b34 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:45.195782 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-94694248-0205-4407-a416-1ae552282a2a tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:45.196936 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-94694248-0205-4407-a416-1ae552282a2a tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:45.203175 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-94694248-0205-4407-a416-1ae552282a2a tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:45.203623 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-94694248-0205-4407-a416-1ae552282a2a tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:45.204384 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-94694248-0205-4407-a416-1ae552282a2a tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:45.204888 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-94694248-0205-4407-a416-1ae552282a2a tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:45.387690 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-391e45f5-2b9d-46e4-90c8-b2029e451b34 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:45.391977 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-94694248-0205-4407-a416-1ae552282a2a tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:45.395231 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-391e45f5-2b9d-46e4-90c8-b2029e451b34 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1510 microversion: 2.1 time: 0.228116 Jul 12 14:41:45.395805 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 154/319] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:45 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1510 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:45.399759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-94694248-0205-4407-a416-1ae552282a2a tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1357 microversion: 2.1 time: 0.207768 Jul 12 14:41:45.400503 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 166/320] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:45 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1357 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:41:46.141884 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-9f153195-1596-46ec-817b-7cf6af41c31c req-8d60e0af-1bd5-4945-8c18-b764d2c3e02c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84cf1792-70fc-4b57-a953-74848c1eb8ca", "name": "network-vif-plugged", "status": "completed", "tag": "158072fd-c24f-4080-926d-9613cf2adbd5"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:41:46.149882 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-9f153195-1596-46ec-817b-7cf6af41c31c req-8d60e0af-1bd5-4945-8c18-b764d2c3e02c service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:46.150322 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-9f153195-1596-46ec-817b-7cf6af41c31c req-8d60e0af-1bd5-4945-8c18-b764d2c3e02c service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:46.301844 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-9f153195-1596-46ec-817b-7cf6af41c31c req-8d60e0af-1bd5-4945-8c18-b764d2c3e02c service nova] Creating event network-vif-plugged:158072fd-c24f-4080-926d-9613cf2adbd5 for instance 84cf1792-70fc-4b57-a953-74848c1eb8ca on hv-cinder-82002 Jul 12 14:41:46.306865 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-9f153195-1596-46ec-817b-7cf6af41c31c req-8d60e0af-1bd5-4945-8c18-b764d2c3e02c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168425 Jul 12 14:41:46.307465 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 155/321] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:41:46.411912 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-26713888-d3b6-4d7b-bad4-2e1f8c2f3e0f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:46.413114 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-26713888-d3b6-4d7b-bad4-2e1f8c2f3e0f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:46.418081 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-77157705-4131-4343-aa25-f65969caae21 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:46.418982 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-77157705-4131-4343-aa25-f65969caae21 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:46.422479 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-26713888-d3b6-4d7b-bad4-2e1f8c2f3e0f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:46.422932 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-26713888-d3b6-4d7b-bad4-2e1f8c2f3e0f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:46.423690 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-26713888-d3b6-4d7b-bad4-2e1f8c2f3e0f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:46.424119 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-26713888-d3b6-4d7b-bad4-2e1f8c2f3e0f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:46.426205 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-77157705-4131-4343-aa25-f65969caae21 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:46.426914 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-77157705-4131-4343-aa25-f65969caae21 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:46.427710 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-77157705-4131-4343-aa25-f65969caae21 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:46.428144 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-77157705-4131-4343-aa25-f65969caae21 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:46.655041 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-26713888-d3b6-4d7b-bad4-2e1f8c2f3e0f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:46.662623 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-77157705-4131-4343-aa25-f65969caae21 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:46.664980 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-26713888-d3b6-4d7b-bad4-2e1f8c2f3e0f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1510 microversion: 2.1 time: 0.257027 Jul 12 14:41:46.670986 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-77157705-4131-4343-aa25-f65969caae21 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1357 microversion: 2.1 time: 0.258005 Jul 12 14:41:46.671632 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 156/322] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:46 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1357 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:41:46.674823 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 167/323] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:46 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1510 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:47.681484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-165d5175-9c74-484d-b168-6ae9636be1e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:47.682540 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-165d5175-9c74-484d-b168-6ae9636be1e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:47.688346 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-ef140fd9-c882-4ae2-b3e2-b69193c3e9f4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:47.688771 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-165d5175-9c74-484d-b168-6ae9636be1e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:47.689102 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-ef140fd9-c882-4ae2-b3e2-b69193c3e9f4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:47.689226 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-165d5175-9c74-484d-b168-6ae9636be1e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:47.690006 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-165d5175-9c74-484d-b168-6ae9636be1e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:47.690576 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-165d5175-9c74-484d-b168-6ae9636be1e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:47.694995 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ef140fd9-c882-4ae2-b3e2-b69193c3e9f4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:47.695488 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ef140fd9-c882-4ae2-b3e2-b69193c3e9f4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:47.696744 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ef140fd9-c882-4ae2-b3e2-b69193c3e9f4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:47.697179 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ef140fd9-c882-4ae2-b3e2-b69193c3e9f4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:47.938693 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-ef140fd9-c882-4ae2-b3e2-b69193c3e9f4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:47.941735 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-165d5175-9c74-484d-b168-6ae9636be1e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:47.947481 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-ef140fd9-c882-4ae2-b3e2-b69193c3e9f4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1357 microversion: 2.1 time: 0.263051 Jul 12 14:41:47.948391 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 168/324] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:47 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1357 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:47.951024 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-165d5175-9c74-484d-b168-6ae9636be1e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1516 microversion: 2.1 time: 0.273310 Jul 12 14:41:47.951588 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 157/325] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:47 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1516 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:48.964292 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-7d35b148-329b-4e38-8434-0a25ca4aca72 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:48.964899 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-7d35b148-329b-4e38-8434-0a25ca4aca72 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:48.971023 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7d35b148-329b-4e38-8434-0a25ca4aca72 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:48.971457 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7d35b148-329b-4e38-8434-0a25ca4aca72 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:48.972215 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7d35b148-329b-4e38-8434-0a25ca4aca72 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:48.972651 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7d35b148-329b-4e38-8434-0a25ca4aca72 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:49.115790 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7d35b148-329b-4e38-8434-0a25ca4aca72 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:49.123488 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-7d35b148-329b-4e38-8434-0a25ca4aca72 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1545 microversion: 2.1 time: 0.163572 Jul 12 14:41:49.124055 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 169/326] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:48 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1545 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:49.145604 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-9c5d7977-f8a9-49ff-8857-c55c381f659e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:49.146222 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-9c5d7977-f8a9-49ff-8857-c55c381f659e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:49.154896 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9c5d7977-f8a9-49ff-8857-c55c381f659e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:49.154896 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9c5d7977-f8a9-49ff-8857-c55c381f659e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:49.154896 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9c5d7977-f8a9-49ff-8857-c55c381f659e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:49.155381 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9c5d7977-f8a9-49ff-8857-c55c381f659e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:49.291006 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-9c5d7977-f8a9-49ff-8857-c55c381f659e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:49.298643 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-9c5d7977-f8a9-49ff-8857-c55c381f659e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1545 microversion: 2.1 time: 0.156826 Jul 12 14:41:49.299203 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 158/327] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:49 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1545 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:49.314764 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-eeed5e40-64b9-4a2f-be78-4aadcc8e1c3b tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:49.318296 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-eeed5e40-64b9-4a2f-be78-4aadcc8e1c3b tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:49.319108 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-eeed5e40-64b9-4a2f-be78-4aadcc8e1c3b tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Searching by: {'deleted': False, 'project_id': '47cd27ad4219485cae0d8d85a2823948'} {{(pid=129981) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 14:41:49.326356 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-eeed5e40-64b9-4a2f-be78-4aadcc8e1c3b tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:49.326799 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-eeed5e40-64b9-4a2f-be78-4aadcc8e1c3b tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:49.327585 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-eeed5e40-64b9-4a2f-be78-4aadcc8e1c3b tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:49.328015 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-eeed5e40-64b9-4a2f-be78-4aadcc8e1c3b tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:49.419883 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.multi_cell_list [None req-eeed5e40-64b9-4a2f-be78-4aadcc8e1c3b tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129981) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 14:41:49.568780 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-f4566107-89d6-4b32-8e77-e0b31710031f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Action: 'create', calling method: .version_select at 0x7f962cca1040>, body: {"keypair": {"name": "tempest-keypair-1663055025", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhmEknCV4CcYjPz8ZX5QIaZr/v3HWEFk8zm3HoV6kMeMPAaVbhIKlel3h+indswevXWKN96FRPHucg9TqOaRm+YEs3ycYkIxPKZUogfLtZgstvK220hlFoJoJ/io5C+XA=="}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:41:49.591481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-f4566107-89d6-4b32-8e77-e0b31710031f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Getting quotas for project fe2b01873d92453599763e5523a862f8. Resources: {'key_pairs'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:41:49.596692 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-f4566107-89d6-4b32-8e77-e0b31710031f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Getting quotas for user 97f1b1e52a984639a504441e3701b981 and project fe2b01873d92453599763e5523a862f8. Resources: {'key_pairs'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:41:49.655971 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-eeed5e40-64b9-4a2f-be78-4aadcc8e1c3b tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.344983 Jul 12 14:41:49.656581 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 170/328] 10.222.0.30 () {58 vars in 1124 bytes} [Tue Jul 12 14:41:49 2022] GET /compute/v2.1/servers => generated 342 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:41:49.666221 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-966abc4f-58bd-488d-b532-6e92ee61a4e7 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:49.666824 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-966abc4f-58bd-488d-b532-6e92ee61a4e7 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:49.672605 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-966abc4f-58bd-488d-b532-6e92ee61a4e7 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:49.673047 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-966abc4f-58bd-488d-b532-6e92ee61a4e7 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:49.678433 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-966abc4f-58bd-488d-b532-6e92ee61a4e7 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:49.678433 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-966abc4f-58bd-488d-b532-6e92ee61a4e7 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:49.700500 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-f4566107-89d6-4b32-8e77-e0b31710031f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.136281 Jul 12 14:41:49.701218 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 159/329] 10.222.0.30 () {60 vars in 1158 bytes} [Tue Jul 12 14:41:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:41:49.803337 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-966abc4f-58bd-488d-b532-6e92ee61a4e7 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:49.810681 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-966abc4f-58bd-488d-b532-6e92ee61a4e7 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1545 microversion: 2.1 time: 0.147995 Jul 12 14:41:49.811311 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 171/330] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:49 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1545 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:41:51.829233 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-200a2ba0-1d62-40f4-8c9e-1a29192c6d3f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b75d8f04-6db7-457c-bdb6-ce7859f3aaf4"}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:41:51.830284 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-200a2ba0-1d62-40f4-8c9e-1a29192c6d3f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:51.836523 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-200a2ba0-1d62-40f4-8c9e-1a29192c6d3f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:51.836965 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-200a2ba0-1d62-40f4-8c9e-1a29192c6d3f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:51.837908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-200a2ba0-1d62-40f4-8c9e-1a29192c6d3f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:51.838339 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-200a2ba0-1d62-40f4-8c9e-1a29192c6d3f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:52.307903 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-4708917d-c53b-439e-8bd3-17db069e4301 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-453339214", "imageRef": "a66ccacb-7b1e-4f51-9eaf-069a356e0fdb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "819820a3-8857-4e62-88e8-410b4a79b856"}], "security_groups": [{"name": "tempest-securitygroup--1856429669"}], "key_name": "tempest-keypair-1663055025", "user_data": "}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:41:52.421328 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.network.neutron [None req-4708917d-c53b-439e-8bd3-17db069e4301 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] validate_networks() for [('819820a3-8857-4e62-88e8-410b4a79b856', None, None, None, None, None)] {{(pid=129981) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:41:52.654884 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:52.731275 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-200a2ba0-1d62-40f4-8c9e-1a29192c6d3f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "POST /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.906410 Jul 12 14:41:52.731890 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 160/331] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Jul 12 14:41:51 2022] POST /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca/os-volume_attachments => generated 194 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:41:52.813970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-4708917d-c53b-439e-8bd3-17db069e4301 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Flavor limits 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:41:52.814431 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-4708917d-c53b-439e-8bd3-17db069e4301 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Image limits 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:41:52.814912 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-4708917d-c53b-439e-8bd3-17db069e4301 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Flavor pref 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:41:52.815324 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-4708917d-c53b-439e-8bd3-17db069e4301 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Image pref 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:41:52.815745 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-4708917d-c53b-439e-8bd3-17db069e4301 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:41:52.826498 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4708917d-c53b-439e-8bd3-17db069e4301 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:52.826957 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4708917d-c53b-439e-8bd3-17db069e4301 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:52.827765 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4708917d-c53b-439e-8bd3-17db069e4301 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:52.828212 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4708917d-c53b-439e-8bd3-17db069e4301 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:52.852034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.quota [None req-4708917d-c53b-439e-8bd3-17db069e4301 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Getting quotas for project fe2b01873d92453599763e5523a862f8. Resources: {'instances', 'cores', 'ram'} {{(pid=129981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:41:52.856063 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.quota [None req-4708917d-c53b-439e-8bd3-17db069e4301 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Getting quotas for user 97f1b1e52a984639a504441e3701b981 and project fe2b01873d92453599763e5523a862f8. Resources: {'instances', 'cores', 'ram'} {{(pid=129981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:41:52.867771 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-4708917d-c53b-439e-8bd3-17db069e4301 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Going to run 1 instances... {{(pid=129981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:41:52.870507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-4708917d-c53b-439e-8bd3-17db069e4301 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a66ccacb-7b1e-4f51-9eaf-069a356e0fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:41:53.033005 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-4708917d-c53b-439e-8bd3-17db069e4301 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.729331 Jul 12 14:41:53.033691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 172/332] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Jul 12 14:41:52 2022] POST /compute/v2.1/servers => generated 409 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 14:41:53.044610 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-eeac51c2-04ec-4e0c-89d9-f63ea227967d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:53.045687 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-eeac51c2-04ec-4e0c-89d9-f63ea227967d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:53.112731 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-eeac51c2-04ec-4e0c-89d9-f63ea227967d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:53.120969 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-eeac51c2-04ec-4e0c-89d9-f63ea227967d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1245 microversion: 2.1 time: 0.080936 Jul 12 14:41:53.121590 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 161/333] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:53 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:54.144831 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-3881f892-867c-4213-84a3-d1e795de9850 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:54.145528 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-3881f892-867c-4213-84a3-d1e795de9850 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:54.153178 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3881f892-867c-4213-84a3-d1e795de9850 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:54.153645 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3881f892-867c-4213-84a3-d1e795de9850 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:54.154406 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3881f892-867c-4213-84a3-d1e795de9850 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:54.155250 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3881f892-867c-4213-84a3-d1e795de9850 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:54.174675 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=100 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:54.225469 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-3881f892-867c-4213-84a3-d1e795de9850 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:54.233729 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-3881f892-867c-4213-84a3-d1e795de9850 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1241 microversion: 2.1 time: 0.093548 Jul 12 14:41:54.245080 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 173/334] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:54 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:55.251756 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-3cd03e34-56ca-4dec-8a80-d33c40fa34e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:55.252355 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-3cd03e34-56ca-4dec-8a80-d33c40fa34e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:55.255143 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:55.260985 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3cd03e34-56ca-4dec-8a80-d33c40fa34e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:55.261457 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3cd03e34-56ca-4dec-8a80-d33c40fa34e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:55.262211 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3cd03e34-56ca-4dec-8a80-d33c40fa34e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:55.262645 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3cd03e34-56ca-4dec-8a80-d33c40fa34e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:55.338257 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-3cd03e34-56ca-4dec-8a80-d33c40fa34e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:55.342607 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-3cd03e34-56ca-4dec-8a80-d33c40fa34e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1305 microversion: 2.1 time: 0.094648 Jul 12 14:41:55.343168 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 162/335] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:55 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:56.359567 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-29d0fe17-e715-485d-b8ed-35fe2ce2500a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:56.360262 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-29d0fe17-e715-485d-b8ed-35fe2ce2500a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:56.366772 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-29d0fe17-e715-485d-b8ed-35fe2ce2500a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:56.367220 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-29d0fe17-e715-485d-b8ed-35fe2ce2500a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:56.367973 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-29d0fe17-e715-485d-b8ed-35fe2ce2500a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:56.368408 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-29d0fe17-e715-485d-b8ed-35fe2ce2500a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:56.430011 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-29d0fe17-e715-485d-b8ed-35fe2ce2500a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:56.437566 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-29d0fe17-e715-485d-b8ed-35fe2ce2500a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1305 microversion: 2.1 time: 0.081770 Jul 12 14:41:56.438124 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 174/336] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:56 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1305 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:57.454287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ac9e99b7-6d46-491e-868a-ae8dd8a2b7ca tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:57.454902 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-ac9e99b7-6d46-491e-868a-ae8dd8a2b7ca tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:57.462908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ac9e99b7-6d46-491e-868a-ae8dd8a2b7ca tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:57.463356 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ac9e99b7-6d46-491e-868a-ae8dd8a2b7ca tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:57.464108 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ac9e99b7-6d46-491e-868a-ae8dd8a2b7ca tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:57.464544 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ac9e99b7-6d46-491e-868a-ae8dd8a2b7ca tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:57.523920 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ac9e99b7-6d46-491e-868a-ae8dd8a2b7ca tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:57.531680 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ac9e99b7-6d46-491e-868a-ae8dd8a2b7ca tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1305 microversion: 2.1 time: 0.081228 Jul 12 14:41:57.532233 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 163/337] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:57 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1305 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:58.437790 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-fd0b894b-9884-430a-9d07-0ede3925ec13 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:58.438953 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-fd0b894b-9884-430a-9d07-0ede3925ec13 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:58.447528 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fd0b894b-9884-430a-9d07-0ede3925ec13 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:58.448052 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fd0b894b-9884-430a-9d07-0ede3925ec13 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:58.448987 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fd0b894b-9884-430a-9d07-0ede3925ec13 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:58.449417 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fd0b894b-9884-430a-9d07-0ede3925ec13 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:58.472870 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-fd0b894b-9884-430a-9d07-0ede3925ec13 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560/ips" status: 200 len: 147 microversion: 2.1 time: 0.039944 Jul 12 14:41:58.473549 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 175/338] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Jul 12 14:41:58 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:41:58.549302 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-1d77efb9-33ff-4854-a7bc-c9bbbfed7546 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:58.550458 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-1d77efb9-33ff-4854-a7bc-c9bbbfed7546 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:58.557753 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1d77efb9-33ff-4854-a7bc-c9bbbfed7546 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:58.558448 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1d77efb9-33ff-4854-a7bc-c9bbbfed7546 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:58.559630 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1d77efb9-33ff-4854-a7bc-c9bbbfed7546 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:58.560223 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1d77efb9-33ff-4854-a7bc-c9bbbfed7546 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:58.745375 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-1d77efb9-33ff-4854-a7bc-c9bbbfed7546 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:58.746589 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-1d77efb9-33ff-4854-a7bc-c9bbbfed7546 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1371 microversion: 2.1 time: 0.201362 Jul 12 14:41:58.747175 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 164/339] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:58 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1371 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:59.763759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-363eada6-bf4f-4884-a024-5e86691f3e1c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:59.764394 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-363eada6-bf4f-4884-a024-5e86691f3e1c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:59.766319 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:59.771257 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-363eada6-bf4f-4884-a024-5e86691f3e1c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:59.771813 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-363eada6-bf4f-4884-a024-5e86691f3e1c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:59.772656 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-363eada6-bf4f-4884-a024-5e86691f3e1c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:59.773254 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-363eada6-bf4f-4884-a024-5e86691f3e1c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:59.988008 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-363eada6-bf4f-4884-a024-5e86691f3e1c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:59.998357 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-363eada6-bf4f-4884-a024-5e86691f3e1c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1371 microversion: 2.1 time: 0.238512 Jul 12 14:41:59.999144 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 176/340] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:59 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:00.411634 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-5e960955-f05e-41ff-8b5f-fe3507fa7168 req-cf216cc3-4f0c-47a9-b137-a40aacaf4e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a9deddf-4864-4ad7-9f64-51b96f7c45eb", "tag": "12bf018a-5099-450d-857c-a8150eca7139"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:42:00.440451 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-5e960955-f05e-41ff-8b5f-fe3507fa7168 req-cf216cc3-4f0c-47a9-b137-a40aacaf4e2d service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:00.441148 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-5e960955-f05e-41ff-8b5f-fe3507fa7168 req-cf216cc3-4f0c-47a9-b137-a40aacaf4e2d service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:00.457874 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-5e960955-f05e-41ff-8b5f-fe3507fa7168 req-cf216cc3-4f0c-47a9-b137-a40aacaf4e2d service nova] Creating event network-changed:12bf018a-5099-450d-857c-a8150eca7139 for instance 8a9deddf-4864-4ad7-9f64-51b96f7c45eb on hv-cinder-82002 Jul 12 14:42:00.463009 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-5e960955-f05e-41ff-8b5f-fe3507fa7168 req-cf216cc3-4f0c-47a9-b137-a40aacaf4e2d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057923 Jul 12 14:42:00.463850 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 165/341] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:42:01.031708 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-bd51d09d-d4db-474a-a47d-7688df474742 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:01.032333 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-bd51d09d-d4db-474a-a47d-7688df474742 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:01.041972 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bd51d09d-d4db-474a-a47d-7688df474742 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:01.042432 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bd51d09d-d4db-474a-a47d-7688df474742 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:01.043218 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bd51d09d-d4db-474a-a47d-7688df474742 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:01.043664 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bd51d09d-d4db-474a-a47d-7688df474742 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:01.254656 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-bd51d09d-d4db-474a-a47d-7688df474742 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:01.266137 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-bd51d09d-d4db-474a-a47d-7688df474742 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1371 microversion: 2.1 time: 0.238107 Jul 12 14:42:01.267243 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 177/342] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:01 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:01.444354 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-830525b9-5a91-4a85-aaa5-baff42c095a6 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:01.444994 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-830525b9-5a91-4a85-aaa5-baff42c095a6 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:01.453514 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-830525b9-5a91-4a85-aaa5-baff42c095a6 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:01.454450 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-830525b9-5a91-4a85-aaa5-baff42c095a6 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:01.455386 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-830525b9-5a91-4a85-aaa5-baff42c095a6 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:01.456595 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-830525b9-5a91-4a85-aaa5-baff42c095a6 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:01.640547 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-830525b9-5a91-4a85-aaa5-baff42c095a6 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:01.648549 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-830525b9-5a91-4a85-aaa5-baff42c095a6 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1591 microversion: 2.1 time: 0.210499 Jul 12 14:42:01.649111 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 166/343] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:01 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1591 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:01.707844 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-de30f242-be6f-4192-99e6-055af9c1a370 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28e328d1-cb00-478b-bb2b-be9de8e839aa"}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:42:01.708905 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-de30f242-be6f-4192-99e6-055af9c1a370 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:01.714947 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-de30f242-be6f-4192-99e6-055af9c1a370 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:01.715403 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-de30f242-be6f-4192-99e6-055af9c1a370 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:01.716366 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-de30f242-be6f-4192-99e6-055af9c1a370 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:01.716809 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-de30f242-be6f-4192-99e6-055af9c1a370 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:02.284745 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-dff2f00f-92ec-4999-81cc-437bdc816010 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:02.285287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-dff2f00f-92ec-4999-81cc-437bdc816010 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:02.292051 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-dff2f00f-92ec-4999-81cc-437bdc816010 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:02.292498 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-dff2f00f-92ec-4999-81cc-437bdc816010 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:02.293305 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-dff2f00f-92ec-4999-81cc-437bdc816010 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:02.293729 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-dff2f00f-92ec-4999-81cc-437bdc816010 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:02.446215 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-dff2f00f-92ec-4999-81cc-437bdc816010 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:02.454459 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-dff2f00f-92ec-4999-81cc-437bdc816010 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1371 microversion: 2.1 time: 0.174986 Jul 12 14:42:02.459908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 167/344] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:02 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:42:02.550046 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-5749c963-3157-40a8-8917-4b293bd6f54c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:02.550625 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-5749c963-3157-40a8-8917-4b293bd6f54c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:02.557327 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5749c963-3157-40a8-8917-4b293bd6f54c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:02.558017 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5749c963-3157-40a8-8917-4b293bd6f54c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:02.558866 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5749c963-3157-40a8-8917-4b293bd6f54c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:02.559378 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5749c963-3157-40a8-8917-4b293bd6f54c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:02.583919 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-5749c963-3157-40a8-8917-4b293bd6f54c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a/ips" status: 200 len: 151 microversion: 2.20 time: 0.038368 Jul 12 14:42:02.584555 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 168/345] 10.222.0.30 () {60 vars in 1288 bytes} [Tue Jul 12 14:42:02 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 14:42:02.847830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell0:SELECT=4 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:02.862607 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell0:SELECT=6 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:03.471467 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-2a2eb132-612e-4b1a-a5fc-a1a64367c5b3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:03.472796 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-2a2eb132-612e-4b1a-a5fc-a1a64367c5b3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:03.488833 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell0:SELECT=6 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:03.497504 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2a2eb132-612e-4b1a-a5fc-a1a64367c5b3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:03.498154 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2a2eb132-612e-4b1a-a5fc-a1a64367c5b3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:03.499090 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2a2eb132-612e-4b1a-a5fc-a1a64367c5b3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:03.499824 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2a2eb132-612e-4b1a-a5fc-a1a64367c5b3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:03.672888 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-2a2eb132-612e-4b1a-a5fc-a1a64367c5b3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:03.681858 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-2a2eb132-612e-4b1a-a5fc-a1a64367c5b3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1371 microversion: 2.1 time: 0.214633 Jul 12 14:42:03.682750 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 169/346] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:03 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:42:03.696594 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-de30f242-be6f-4192-99e6-055af9c1a370 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "POST /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.992705 Jul 12 14:42:03.697221 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 178/347] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Jul 12 14:42:01 2022] POST /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560/os-volume_attachments => generated 194 bytes in 1994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:42:03.986859 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-0f7567a2-80df-492a-a70b-4d17cfcbbb48 req-d0f095c4-c8c0-407f-86da-9abe091dc94c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84cf1792-70fc-4b57-a953-74848c1eb8ca", "tag": "158072fd-c24f-4080-926d-9613cf2adbd5"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:42:03.997871 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-0f7567a2-80df-492a-a70b-4d17cfcbbb48 req-d0f095c4-c8c0-407f-86da-9abe091dc94c service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:03.998383 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-0f7567a2-80df-492a-a70b-4d17cfcbbb48 req-d0f095c4-c8c0-407f-86da-9abe091dc94c service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:04.014074 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-0f7567a2-80df-492a-a70b-4d17cfcbbb48 req-d0f095c4-c8c0-407f-86da-9abe091dc94c service nova] Creating event network-changed:158072fd-c24f-4080-926d-9613cf2adbd5 for instance 84cf1792-70fc-4b57-a953-74848c1eb8ca on hv-cinder-82002 Jul 12 14:42:04.019571 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-0f7567a2-80df-492a-a70b-4d17cfcbbb48 req-d0f095c4-c8c0-407f-86da-9abe091dc94c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036179 Jul 12 14:42:04.021259 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 170/348] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:42:04.700532 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-9fae17d9-14e7-4199-bd47-1bab1930a948 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:04.703672 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-9fae17d9-14e7-4199-bd47-1bab1930a948 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:04.716626 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9fae17d9-14e7-4199-bd47-1bab1930a948 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:04.717278 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9fae17d9-14e7-4199-bd47-1bab1930a948 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:04.722085 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9fae17d9-14e7-4199-bd47-1bab1930a948 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:04.722831 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9fae17d9-14e7-4199-bd47-1bab1930a948 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:04.910039 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-9fae17d9-14e7-4199-bd47-1bab1930a948 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:04.918437 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-9fae17d9-14e7-4199-bd47-1bab1930a948 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1371 microversion: 2.1 time: 0.222824 Jul 12 14:42:04.925291 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 179/349] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:04 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:05.703831 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-1da0acbd-d7a4-4cd0-a2f8-4c278922195e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:42:05.704540 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-1da0acbd-d7a4-4cd0-a2f8-4c278922195e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:05.713051 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1da0acbd-d7a4-4cd0-a2f8-4c278922195e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:05.713590 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1da0acbd-d7a4-4cd0-a2f8-4c278922195e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:05.714363 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1da0acbd-d7a4-4cd0-a2f8-4c278922195e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:05.714926 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1da0acbd-d7a4-4cd0-a2f8-4c278922195e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:05.746107 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.objects.instance [None req-1da0acbd-d7a4-4cd0-a2f8-4c278922195e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lazy-loading 'flavor' on Instance uuid 26eeea2d-c1c2-46a7-b727-269cf6dce92a {{(pid=129980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:42:05.936244 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-8eafec62-db7f-4c2a-bd66-180e94c4324b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:05.936854 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-8eafec62-db7f-4c2a-bd66-180e94c4324b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:05.950460 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8eafec62-db7f-4c2a-bd66-180e94c4324b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:05.950919 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8eafec62-db7f-4c2a-bd66-180e94c4324b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:05.956423 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8eafec62-db7f-4c2a-bd66-180e94c4324b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:05.956423 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8eafec62-db7f-4c2a-bd66-180e94c4324b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:06.094187 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-8eafec62-db7f-4c2a-bd66-180e94c4324b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:06.111451 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-8eafec62-db7f-4c2a-bd66-180e94c4324b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1371 microversion: 2.1 time: 0.179022 Jul 12 14:42:06.117722 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 180/350] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:05 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:42:06.373416 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-1da0acbd-d7a4-4cd0-a2f8-4c278922195e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "POST /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a/action" status: 202 len: 0 microversion: 2.20 time: 0.674394 Jul 12 14:42:06.374280 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 171/351] 10.222.0.30 () {62 vars in 1318 bytes} [Tue Jul 12 14:42:05 2022] POST /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a/action => generated 0 bytes in 677 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:42:06.394071 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e52c3e5c-2811-4151-916c-c0c8101efca3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:06.395292 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-e52c3e5c-2811-4151-916c-c0c8101efca3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:06.406919 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e52c3e5c-2811-4151-916c-c0c8101efca3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:06.407852 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e52c3e5c-2811-4151-916c-c0c8101efca3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:06.408865 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e52c3e5c-2811-4151-916c-c0c8101efca3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:06.409480 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e52c3e5c-2811-4151-916c-c0c8101efca3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:06.575786 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e52c3e5c-2811-4151-916c-c0c8101efca3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:06.583978 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e52c3e5c-2811-4151-916c-c0c8101efca3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:06.585570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e52c3e5c-2811-4151-916c-c0c8101efca3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:06.586759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-e52c3e5c-2811-4151-916c-c0c8101efca3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1723 microversion: 2.20 time: 0.207688 Jul 12 14:42:06.587315 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 181/352] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:06 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:42:06.647412 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-75f3d953-c7f6-46da-a839-46a751a25c15 req-c23de572-513a-4670-85df-2e60cf5fb44d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a9deddf-4864-4ad7-9f64-51b96f7c45eb", "name": "network-vif-plugged", "status": "completed", "tag": "12bf018a-5099-450d-857c-a8150eca7139"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:42:06.655967 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-75f3d953-c7f6-46da-a839-46a751a25c15 req-c23de572-513a-4670-85df-2e60cf5fb44d service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:06.656419 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-75f3d953-c7f6-46da-a839-46a751a25c15 req-c23de572-513a-4670-85df-2e60cf5fb44d service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:06.668088 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-75f3d953-c7f6-46da-a839-46a751a25c15 req-c23de572-513a-4670-85df-2e60cf5fb44d service nova] Creating event network-vif-plugged:12bf018a-5099-450d-857c-a8150eca7139 for instance 8a9deddf-4864-4ad7-9f64-51b96f7c45eb on hv-cinder-82002 Jul 12 14:42:06.673109 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-75f3d953-c7f6-46da-a839-46a751a25c15 req-c23de572-513a-4670-85df-2e60cf5fb44d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029822 Jul 12 14:42:06.677151 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 172/353] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:42:07.056659 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-cb2754ff-90fc-4c02-9857-f8576f9d1fd9 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1421566928"}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:42:07.057250 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-cb2754ff-90fc-4c02-9857-f8576f9d1fd9 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:07.063720 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-cb2754ff-90fc-4c02-9857-f8576f9d1fd9 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:07.064174 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-cb2754ff-90fc-4c02-9857-f8576f9d1fd9 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:07.064934 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-cb2754ff-90fc-4c02-9857-f8576f9d1fd9 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:07.065409 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-cb2754ff-90fc-4c02-9857-f8576f9d1fd9 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:07.129970 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-60a9fd1f-60fa-4394-bf2e-458006e0f479 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:07.130756 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-60a9fd1f-60fa-4394-bf2e-458006e0f479 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:07.137055 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-60a9fd1f-60fa-4394-bf2e-458006e0f479 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:07.137537 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-60a9fd1f-60fa-4394-bf2e-458006e0f479 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:07.138300 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-60a9fd1f-60fa-4394-bf2e-458006e0f479 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:07.138742 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-60a9fd1f-60fa-4394-bf2e-458006e0f479 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:07.332401 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.network.security_group_api [None req-cb2754ff-90fc-4c02-9857-f8576f9d1fd9 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Adding security group b2d1e4c1-5d97-4af9-9c98-5c4ab65a3224 to port 158072fd-c24f-4080-926d-9613cf2adbd5 Jul 12 14:42:07.399691 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-60a9fd1f-60fa-4394-bf2e-458006e0f479 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:07.412016 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-60a9fd1f-60fa-4394-bf2e-458006e0f479 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1371 microversion: 2.1 time: 0.286707 Jul 12 14:42:07.412599 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 173/354] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:07 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1371 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:42:07.607354 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-db8674a0-43bc-4f4c-aaf3-86e9c26edde8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:07.608367 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-db8674a0-43bc-4f4c-aaf3-86e9c26edde8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:07.614802 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-db8674a0-43bc-4f4c-aaf3-86e9c26edde8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:07.615409 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-db8674a0-43bc-4f4c-aaf3-86e9c26edde8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:07.616186 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-db8674a0-43bc-4f4c-aaf3-86e9c26edde8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:07.616626 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-db8674a0-43bc-4f4c-aaf3-86e9c26edde8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:08.024380 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-db8674a0-43bc-4f4c-aaf3-86e9c26edde8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:08.034134 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-db8674a0-43bc-4f4c-aaf3-86e9c26edde8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:08.035834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-db8674a0-43bc-4f4c-aaf3-86e9c26edde8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:08.037194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-db8674a0-43bc-4f4c-aaf3-86e9c26edde8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1723 microversion: 2.20 time: 0.436235 Jul 12 14:42:08.037800 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 174/355] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:07 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1723 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:42:08.081336 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-cb2754ff-90fc-4c02-9857-f8576f9d1fd9 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "POST /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca/action" status: 202 len: 0 microversion: 2.1 time: 1.023670 Jul 12 14:42:08.081336 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 182/356] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Jul 12 14:42:07 2022] POST /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca/action => generated 0 bytes in 1026 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:42:08.087020 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-a6916f7a-90b0-4379-ad5e-778d60a5b2bd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:08.087638 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-a6916f7a-90b0-4379-ad5e-778d60a5b2bd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:08.091188 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-41db66bf-6208-4165-af1b-b46b13096158 req-f1b41ea0-982b-4e9f-980d-21f0aba19d00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84cf1792-70fc-4b57-a953-74848c1eb8ca", "tag": "158072fd-c24f-4080-926d-9613cf2adbd5"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:42:08.104867 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-41db66bf-6208-4165-af1b-b46b13096158 req-f1b41ea0-982b-4e9f-980d-21f0aba19d00 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:08.105350 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-41db66bf-6208-4165-af1b-b46b13096158 req-f1b41ea0-982b-4e9f-980d-21f0aba19d00 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:08.106331 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a6916f7a-90b0-4379-ad5e-778d60a5b2bd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:08.106791 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a6916f7a-90b0-4379-ad5e-778d60a5b2bd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:08.107581 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a6916f7a-90b0-4379-ad5e-778d60a5b2bd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:08.108021 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a6916f7a-90b0-4379-ad5e-778d60a5b2bd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:08.137827 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-41db66bf-6208-4165-af1b-b46b13096158 req-f1b41ea0-982b-4e9f-980d-21f0aba19d00 service nova] Creating event network-changed:158072fd-c24f-4080-926d-9613cf2adbd5 for instance 84cf1792-70fc-4b57-a953-74848c1eb8ca on hv-cinder-82002 Jul 12 14:42:08.146377 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-41db66bf-6208-4165-af1b-b46b13096158 req-f1b41ea0-982b-4e9f-980d-21f0aba19d00 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064770 Jul 12 14:42:08.148127 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 175/357] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:42:08.307740 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-a6916f7a-90b0-4379-ad5e-778d60a5b2bd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:08.318786 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-a6916f7a-90b0-4379-ad5e-778d60a5b2bd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1757 microversion: 2.1 time: 0.235216 Jul 12 14:42:08.320045 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 183/358] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:08 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1757 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:08.439578 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-2bac4420-c530-4ed8-bd99-764f92228486 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:08.440293 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-2bac4420-c530-4ed8-bd99-764f92228486 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:08.450709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2bac4420-c530-4ed8-bd99-764f92228486 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:08.451246 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2bac4420-c530-4ed8-bd99-764f92228486 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:08.452171 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2bac4420-c530-4ed8-bd99-764f92228486 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:08.452746 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2bac4420-c530-4ed8-bd99-764f92228486 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:08.753150 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-2bac4420-c530-4ed8-bd99-764f92228486 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:08.762735 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-2bac4420-c530-4ed8-bd99-764f92228486 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1371 microversion: 2.1 time: 0.330626 Jul 12 14:42:08.763841 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 176/359] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:08 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1371 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:09.056033 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-78c964c2-1836-4bc3-b705-6eedb4c8db0c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:09.056654 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-78c964c2-1836-4bc3-b705-6eedb4c8db0c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:09.063439 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-78c964c2-1836-4bc3-b705-6eedb4c8db0c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:09.063885 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-78c964c2-1836-4bc3-b705-6eedb4c8db0c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:09.064844 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-78c964c2-1836-4bc3-b705-6eedb4c8db0c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:09.067847 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-78c964c2-1836-4bc3-b705-6eedb4c8db0c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:09.209198 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-78c964c2-1836-4bc3-b705-6eedb4c8db0c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:09.218118 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-78c964c2-1836-4bc3-b705-6eedb4c8db0c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:09.219780 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-78c964c2-1836-4bc3-b705-6eedb4c8db0c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:09.220942 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-78c964c2-1836-4bc3-b705-6eedb4c8db0c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1723 microversion: 2.20 time: 0.169510 Jul 12 14:42:09.221528 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 184/360] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:09 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:09.780799 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-8bc57c80-caae-489b-9269-96e48e940ddd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:09.781389 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-8bc57c80-caae-489b-9269-96e48e940ddd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:09.788263 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8bc57c80-caae-489b-9269-96e48e940ddd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:09.788793 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8bc57c80-caae-489b-9269-96e48e940ddd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:09.790237 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8bc57c80-caae-489b-9269-96e48e940ddd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:09.790677 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8bc57c80-caae-489b-9269-96e48e940ddd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:09.999663 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-8bc57c80-caae-489b-9269-96e48e940ddd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:10.007460 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-8bc57c80-caae-489b-9269-96e48e940ddd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1564 microversion: 2.1 time: 0.230644 Jul 12 14:42:10.008032 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 177/361] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:09 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1564 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:10.032159 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c7e3e0da-7621-414e-b316-f4ba51601273 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:10.033070 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-c7e3e0da-7621-414e-b316-f4ba51601273 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:10.039693 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c7e3e0da-7621-414e-b316-f4ba51601273 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:10.043765 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c7e3e0da-7621-414e-b316-f4ba51601273 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:10.043765 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c7e3e0da-7621-414e-b316-f4ba51601273 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:10.043765 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c7e3e0da-7621-414e-b316-f4ba51601273 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:10.154736 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-c7e3e0da-7621-414e-b316-f4ba51601273 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127847 Jul 12 14:42:10.155357 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 185/362] 10.222.0.30 () {58 vars in 1274 bytes} [Tue Jul 12 14:42:10 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:42:10.240463 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-9cc20849-36f4-4fce-87a6-fa139e7fb2c4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:10.242121 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-9cc20849-36f4-4fce-87a6-fa139e7fb2c4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:10.249475 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9cc20849-36f4-4fce-87a6-fa139e7fb2c4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:10.249918 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9cc20849-36f4-4fce-87a6-fa139e7fb2c4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:10.250896 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9cc20849-36f4-4fce-87a6-fa139e7fb2c4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:10.251329 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9cc20849-36f4-4fce-87a6-fa139e7fb2c4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:10.572758 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-9cc20849-36f4-4fce-87a6-fa139e7fb2c4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:10.581127 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-9cc20849-36f4-4fce-87a6-fa139e7fb2c4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:10.582616 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-9cc20849-36f4-4fce-87a6-fa139e7fb2c4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:10.583841 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-9cc20849-36f4-4fce-87a6-fa139e7fb2c4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1723 microversion: 2.20 time: 0.347696 Jul 12 14:42:10.584314 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 178/363] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:10 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1723 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:11.416039 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-6d881805-89e7-4870-8508-654591fb224d req-354541b0-d8f1-471b-82ca-b83a0cd8066b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a9deddf-4864-4ad7-9f64-51b96f7c45eb", "tag": "12bf018a-5099-450d-857c-a8150eca7139"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:42:11.426538 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-6d881805-89e7-4870-8508-654591fb224d req-354541b0-d8f1-471b-82ca-b83a0cd8066b service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:11.426538 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-6d881805-89e7-4870-8508-654591fb224d req-354541b0-d8f1-471b-82ca-b83a0cd8066b service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:11.451740 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-6d881805-89e7-4870-8508-654591fb224d req-354541b0-d8f1-471b-82ca-b83a0cd8066b service nova] Creating event network-changed:12bf018a-5099-450d-857c-a8150eca7139 for instance 8a9deddf-4864-4ad7-9f64-51b96f7c45eb on hv-cinder-82002 Jul 12 14:42:11.458174 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-6d881805-89e7-4870-8508-654591fb224d req-354541b0-d8f1-471b-82ca-b83a0cd8066b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047130 Jul 12 14:42:11.459105 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 186/364] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:42:11.608549 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-dd11d065-d338-4165-b591-49fe574a83f7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:11.609207 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-dd11d065-d338-4165-b591-49fe574a83f7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:11.623597 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-dd11d065-d338-4165-b591-49fe574a83f7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:11.624317 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-dd11d065-d338-4165-b591-49fe574a83f7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:11.625361 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-dd11d065-d338-4165-b591-49fe574a83f7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:11.625954 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-dd11d065-d338-4165-b591-49fe574a83f7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:11.646330 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:11.834442 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-dd11d065-d338-4165-b591-49fe574a83f7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:11.850227 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-dd11d065-d338-4165-b591-49fe574a83f7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:11.853567 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-dd11d065-d338-4165-b591-49fe574a83f7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:11.856015 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-dd11d065-d338-4165-b591-49fe574a83f7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1723 microversion: 2.20 time: 0.251636 Jul 12 14:42:11.856586 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 179/365] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:11 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:12.689824 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-56abfdca-bad0-4972-ae2f-e9d95d9bb370 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:42:12.698956 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-56abfdca-bad0-4972-ae2f-e9d95d9bb370 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:12.699735 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-56abfdca-bad0-4972-ae2f-e9d95d9bb370 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:12.772706 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-56abfdca-bad0-4972-ae2f-e9d95d9bb370 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Going to try to stop instance {{(pid=129981) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 12 14:42:12.875367 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-7a0e9e09-e706-43e6-b8b8-b965030abd14 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:12.876047 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-7a0e9e09-e706-43e6-b8b8-b965030abd14 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:12.883844 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7a0e9e09-e706-43e6-b8b8-b965030abd14 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:12.884382 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7a0e9e09-e706-43e6-b8b8-b965030abd14 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:12.885258 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7a0e9e09-e706-43e6-b8b8-b965030abd14 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:12.885751 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7a0e9e09-e706-43e6-b8b8-b965030abd14 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:12.964546 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-56abfdca-bad0-4972-ae2f-e9d95d9bb370 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "POST /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560/action" status: 202 len: 0 microversion: 2.1 time: 0.280802 Jul 12 14:42:12.965700 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 187/366] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Jul 12 14:42:12 2022] POST /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 14:42:12.988647 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-0fdc907e-2383-49f6-9fb0-898d6e585b6c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:12.989962 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-0fdc907e-2383-49f6-9fb0-898d6e585b6c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:12.999544 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0fdc907e-2383-49f6-9fb0-898d6e585b6c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:12.999948 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0fdc907e-2383-49f6-9fb0-898d6e585b6c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:13.001759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0fdc907e-2383-49f6-9fb0-898d6e585b6c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:13.006048 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0fdc907e-2383-49f6-9fb0-898d6e585b6c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:13.052317 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-7a0e9e09-e706-43e6-b8b8-b965030abd14 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:13.060821 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-7a0e9e09-e706-43e6-b8b8-b965030abd14 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:13.062466 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-7a0e9e09-e706-43e6-b8b8-b965030abd14 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:13.063635 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-7a0e9e09-e706-43e6-b8b8-b965030abd14 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1723 microversion: 2.20 time: 0.192343 Jul 12 14:42:13.064188 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 180/367] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:12 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:42:13.164721 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-0fdc907e-2383-49f6-9fb0-898d6e585b6c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:13.173461 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-0fdc907e-2383-49f6-9fb0-898d6e585b6c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1724 microversion: 2.1 time: 0.193022 Jul 12 14:42:13.174109 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 188/368] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:12 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:14.094482 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-c707b407-32f1-4866-bd23-4625f9d90e2b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:14.094482 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-c707b407-32f1-4866-bd23-4625f9d90e2b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:14.101575 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c707b407-32f1-4866-bd23-4625f9d90e2b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:14.102528 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c707b407-32f1-4866-bd23-4625f9d90e2b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:14.103303 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c707b407-32f1-4866-bd23-4625f9d90e2b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:14.103736 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c707b407-32f1-4866-bd23-4625f9d90e2b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:14.191183 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-2e408a62-1118-4d57-903d-0e994cd2f80a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:14.192288 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-2e408a62-1118-4d57-903d-0e994cd2f80a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:14.199699 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2e408a62-1118-4d57-903d-0e994cd2f80a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:14.200320 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2e408a62-1118-4d57-903d-0e994cd2f80a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:14.201330 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2e408a62-1118-4d57-903d-0e994cd2f80a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:14.201919 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2e408a62-1118-4d57-903d-0e994cd2f80a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:14.230360 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:14.241936 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-c707b407-32f1-4866-bd23-4625f9d90e2b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:14.250613 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-c707b407-32f1-4866-bd23-4625f9d90e2b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:14.252275 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-c707b407-32f1-4866-bd23-4625f9d90e2b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:14.253650 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-c707b407-32f1-4866-bd23-4625f9d90e2b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1723 microversion: 2.20 time: 0.164883 Jul 12 14:42:14.264395 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 181/369] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:14 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:14.360655 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-2e408a62-1118-4d57-903d-0e994cd2f80a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:14.369289 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-2e408a62-1118-4d57-903d-0e994cd2f80a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1724 microversion: 2.1 time: 0.181966 Jul 12 14:42:14.369849 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 189/370] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:14 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:42:15.271770 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-7872fde1-5c1f-45e8-b2c9-98fa23d3c085 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:15.272390 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-7872fde1-5c1f-45e8-b2c9-98fa23d3c085 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:15.278893 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7872fde1-5c1f-45e8-b2c9-98fa23d3c085 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:15.279343 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7872fde1-5c1f-45e8-b2c9-98fa23d3c085 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:15.280100 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7872fde1-5c1f-45e8-b2c9-98fa23d3c085 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:15.280537 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7872fde1-5c1f-45e8-b2c9-98fa23d3c085 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:15.386858 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-af117f0f-1983-40b6-a3c6-b14db9ae16e6 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:15.387595 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-af117f0f-1983-40b6-a3c6-b14db9ae16e6 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:15.394297 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-af117f0f-1983-40b6-a3c6-b14db9ae16e6 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:15.394743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-af117f0f-1983-40b6-a3c6-b14db9ae16e6 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:15.395507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-af117f0f-1983-40b6-a3c6-b14db9ae16e6 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:15.395944 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-af117f0f-1983-40b6-a3c6-b14db9ae16e6 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:15.405748 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-7872fde1-5c1f-45e8-b2c9-98fa23d3c085 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:15.413719 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-7872fde1-5c1f-45e8-b2c9-98fa23d3c085 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:15.415828 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-7872fde1-5c1f-45e8-b2c9-98fa23d3c085 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:15.416981 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-7872fde1-5c1f-45e8-b2c9-98fa23d3c085 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1723 microversion: 2.20 time: 0.149057 Jul 12 14:42:15.417595 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 182/371] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:15 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:15.527076 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-af117f0f-1983-40b6-a3c6-b14db9ae16e6 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:15.535215 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-af117f0f-1983-40b6-a3c6-b14db9ae16e6 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1724 microversion: 2.1 time: 0.152572 Jul 12 14:42:15.535775 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 190/372] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:15 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:42:16.436039 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-31b02090-e4b1-4172-872a-89d6b945c24e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:16.439599 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-31b02090-e4b1-4172-872a-89d6b945c24e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:16.444556 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-31b02090-e4b1-4172-872a-89d6b945c24e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:16.444934 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-31b02090-e4b1-4172-872a-89d6b945c24e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:16.446292 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-31b02090-e4b1-4172-872a-89d6b945c24e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:16.446730 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-31b02090-e4b1-4172-872a-89d6b945c24e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:16.551629 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-89296ba2-2f24-4daf-8394-f6fc4815aaf4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:16.552231 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-89296ba2-2f24-4daf-8394-f6fc4815aaf4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:16.559244 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-89296ba2-2f24-4daf-8394-f6fc4815aaf4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:16.559686 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-89296ba2-2f24-4daf-8394-f6fc4815aaf4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:16.560442 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-89296ba2-2f24-4daf-8394-f6fc4815aaf4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:16.560869 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-89296ba2-2f24-4daf-8394-f6fc4815aaf4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:16.577335 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-31b02090-e4b1-4172-872a-89d6b945c24e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:16.585422 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-31b02090-e4b1-4172-872a-89d6b945c24e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:16.587099 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-31b02090-e4b1-4172-872a-89d6b945c24e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:16.588375 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-31b02090-e4b1-4172-872a-89d6b945c24e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1723 microversion: 2.20 time: 0.156440 Jul 12 14:42:16.588938 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 183/373] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:16 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:16.692292 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-89296ba2-2f24-4daf-8394-f6fc4815aaf4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:16.701034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-89296ba2-2f24-4daf-8394-f6fc4815aaf4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1724 microversion: 2.1 time: 0.153160 Jul 12 14:42:16.701652 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 191/374] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:16 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:42:17.605898 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-11d93c8a-6421-4aa3-bae0-3097c5d2d1a4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:17.606514 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-11d93c8a-6421-4aa3-bae0-3097c5d2d1a4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:17.612958 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-11d93c8a-6421-4aa3-bae0-3097c5d2d1a4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:17.613485 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-11d93c8a-6421-4aa3-bae0-3097c5d2d1a4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:17.614264 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-11d93c8a-6421-4aa3-bae0-3097c5d2d1a4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:17.614712 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-11d93c8a-6421-4aa3-bae0-3097c5d2d1a4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:17.718878 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-b3f7f6a4-6537-4f0f-a84d-91e35b9ef1d1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:17.719491 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-b3f7f6a4-6537-4f0f-a84d-91e35b9ef1d1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:17.726043 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b3f7f6a4-6537-4f0f-a84d-91e35b9ef1d1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:17.726840 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b3f7f6a4-6537-4f0f-a84d-91e35b9ef1d1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:17.727607 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b3f7f6a4-6537-4f0f-a84d-91e35b9ef1d1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:17.728040 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b3f7f6a4-6537-4f0f-a84d-91e35b9ef1d1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:17.748659 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-11d93c8a-6421-4aa3-bae0-3097c5d2d1a4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:17.757137 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-11d93c8a-6421-4aa3-bae0-3097c5d2d1a4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:17.759332 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-11d93c8a-6421-4aa3-bae0-3097c5d2d1a4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:17.760539 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-11d93c8a-6421-4aa3-bae0-3097c5d2d1a4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1723 microversion: 2.20 time: 0.158695 Jul 12 14:42:17.761116 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 184/375] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:17 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:17.866440 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-b3f7f6a4-6537-4f0f-a84d-91e35b9ef1d1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:17.876051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-b3f7f6a4-6537-4f0f-a84d-91e35b9ef1d1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1724 microversion: 2.1 time: 0.161022 Jul 12 14:42:17.885704 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 192/376] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:17 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:42:18.779217 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-55d1ef8c-b09a-46c5-9aff-8d5bcc640122 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:18.779739 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-55d1ef8c-b09a-46c5-9aff-8d5bcc640122 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:18.786210 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-55d1ef8c-b09a-46c5-9aff-8d5bcc640122 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:18.786662 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-55d1ef8c-b09a-46c5-9aff-8d5bcc640122 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:18.787422 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-55d1ef8c-b09a-46c5-9aff-8d5bcc640122 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:18.787858 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-55d1ef8c-b09a-46c5-9aff-8d5bcc640122 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:18.893594 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d8703b4d-26d8-4311-8316-871fd2574fdb tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:18.894210 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-d8703b4d-26d8-4311-8316-871fd2574fdb tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:18.901368 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d8703b4d-26d8-4311-8316-871fd2574fdb tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:18.901823 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d8703b4d-26d8-4311-8316-871fd2574fdb tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:18.902604 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d8703b4d-26d8-4311-8316-871fd2574fdb tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:18.903044 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d8703b4d-26d8-4311-8316-871fd2574fdb tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:19.198934 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-55d1ef8c-b09a-46c5-9aff-8d5bcc640122 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:19.207015 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-55d1ef8c-b09a-46c5-9aff-8d5bcc640122 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:19.208495 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-55d1ef8c-b09a-46c5-9aff-8d5bcc640122 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:19.209731 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-55d1ef8c-b09a-46c5-9aff-8d5bcc640122 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1723 microversion: 2.20 time: 0.434505 Jul 12 14:42:19.210474 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 185/377] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:18 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1723 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:19.250694 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d8703b4d-26d8-4311-8316-871fd2574fdb tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:19.258664 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-d8703b4d-26d8-4311-8316-871fd2574fdb tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1724 microversion: 2.1 time: 0.368971 Jul 12 14:42:19.259230 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 193/378] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:18 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1724 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:42:20.230208 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-cc3ecea7-bf93-4f00-9f45-f2883e79f26d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:20.230944 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-cc3ecea7-bf93-4f00-9f45-f2883e79f26d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:20.237577 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-cc3ecea7-bf93-4f00-9f45-f2883e79f26d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:20.238024 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-cc3ecea7-bf93-4f00-9f45-f2883e79f26d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:20.238788 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-cc3ecea7-bf93-4f00-9f45-f2883e79f26d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:20.239217 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-cc3ecea7-bf93-4f00-9f45-f2883e79f26d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:20.275985 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-282c6b2f-cdc5-4c18-882a-9c8e57fa285b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:20.276599 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-282c6b2f-cdc5-4c18-882a-9c8e57fa285b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:20.283001 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-282c6b2f-cdc5-4c18-882a-9c8e57fa285b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:20.283539 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-282c6b2f-cdc5-4c18-882a-9c8e57fa285b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:20.284368 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-282c6b2f-cdc5-4c18-882a-9c8e57fa285b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:20.284753 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-282c6b2f-cdc5-4c18-882a-9c8e57fa285b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:20.427072 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-cc3ecea7-bf93-4f00-9f45-f2883e79f26d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:20.438721 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-cc3ecea7-bf93-4f00-9f45-f2883e79f26d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:20.441999 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-cc3ecea7-bf93-4f00-9f45-f2883e79f26d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:20.441999 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-cc3ecea7-bf93-4f00-9f45-f2883e79f26d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1723 microversion: 2.20 time: 0.216107 Jul 12 14:42:20.442620 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 186/379] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:20 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:42:20.467671 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-282c6b2f-cdc5-4c18-882a-9c8e57fa285b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:20.475781 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-282c6b2f-cdc5-4c18-882a-9c8e57fa285b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1724 microversion: 2.1 time: 0.204110 Jul 12 14:42:20.476870 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 194/380] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:20 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:42:21.460024 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-250dfe6d-28ed-4e4b-b86e-6e83be9855f9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:21.461128 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-250dfe6d-28ed-4e4b-b86e-6e83be9855f9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:21.467873 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-250dfe6d-28ed-4e4b-b86e-6e83be9855f9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:21.468324 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-250dfe6d-28ed-4e4b-b86e-6e83be9855f9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:21.469070 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-250dfe6d-28ed-4e4b-b86e-6e83be9855f9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:21.469528 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-250dfe6d-28ed-4e4b-b86e-6e83be9855f9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:21.498677 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-818ff2fc-2972-48e6-bd5e-99c8acf218f4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:21.499306 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-818ff2fc-2972-48e6-bd5e-99c8acf218f4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:21.505744 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-818ff2fc-2972-48e6-bd5e-99c8acf218f4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:21.506184 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-818ff2fc-2972-48e6-bd5e-99c8acf218f4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:21.506937 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-818ff2fc-2972-48e6-bd5e-99c8acf218f4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:21.511386 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-818ff2fc-2972-48e6-bd5e-99c8acf218f4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:21.643624 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-250dfe6d-28ed-4e4b-b86e-6e83be9855f9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:21.653537 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-250dfe6d-28ed-4e4b-b86e-6e83be9855f9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:21.655388 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-250dfe6d-28ed-4e4b-b86e-6e83be9855f9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:21.656582 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-250dfe6d-28ed-4e4b-b86e-6e83be9855f9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1723 microversion: 2.20 time: 0.200430 Jul 12 14:42:21.664326 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 187/381] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:21 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:21.691338 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-818ff2fc-2972-48e6-bd5e-99c8acf218f4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:21.699392 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-818ff2fc-2972-48e6-bd5e-99c8acf218f4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1724 microversion: 2.1 time: 0.204455 Jul 12 14:42:21.699891 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 195/382] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:21 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:42:22.675936 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-55b884ae-d80a-4a2b-9c1a-0ec57708cbc6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:22.676579 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-55b884ae-d80a-4a2b-9c1a-0ec57708cbc6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:22.683684 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-55b884ae-d80a-4a2b-9c1a-0ec57708cbc6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:22.684132 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-55b884ae-d80a-4a2b-9c1a-0ec57708cbc6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:22.684891 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-55b884ae-d80a-4a2b-9c1a-0ec57708cbc6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:22.685363 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-55b884ae-d80a-4a2b-9c1a-0ec57708cbc6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:22.716045 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d9058b45-a52f-45bd-b0a1-654ad14d7aa8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:22.716650 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-d9058b45-a52f-45bd-b0a1-654ad14d7aa8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:22.724259 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d9058b45-a52f-45bd-b0a1-654ad14d7aa8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:22.724725 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d9058b45-a52f-45bd-b0a1-654ad14d7aa8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:22.725565 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d9058b45-a52f-45bd-b0a1-654ad14d7aa8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:22.726518 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d9058b45-a52f-45bd-b0a1-654ad14d7aa8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:22.866044 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-55b884ae-d80a-4a2b-9c1a-0ec57708cbc6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:22.874874 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-55b884ae-d80a-4a2b-9c1a-0ec57708cbc6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:22.876571 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-55b884ae-d80a-4a2b-9c1a-0ec57708cbc6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:22.877804 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-55b884ae-d80a-4a2b-9c1a-0ec57708cbc6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1723 microversion: 2.20 time: 0.205885 Jul 12 14:42:22.878828 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 188/383] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:22 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:22.897439 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d9058b45-a52f-45bd-b0a1-654ad14d7aa8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:22.908538 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-d9058b45-a52f-45bd-b0a1-654ad14d7aa8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1724 microversion: 2.1 time: 0.196343 Jul 12 14:42:22.909140 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 196/384] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:22 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:42:23.895797 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-80ea0e9b-6c5a-4e4c-beb5-37f359eadcad tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:23.896404 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-80ea0e9b-6c5a-4e4c-beb5-37f359eadcad tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:23.903878 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-80ea0e9b-6c5a-4e4c-beb5-37f359eadcad tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:23.904324 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-80ea0e9b-6c5a-4e4c-beb5-37f359eadcad tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:23.905083 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-80ea0e9b-6c5a-4e4c-beb5-37f359eadcad tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:23.905545 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-80ea0e9b-6c5a-4e4c-beb5-37f359eadcad tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:23.926580 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-a1f8e3ce-102d-4d90-8e9c-8c1ae2e94026 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:23.927188 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-a1f8e3ce-102d-4d90-8e9c-8c1ae2e94026 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:23.934274 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a1f8e3ce-102d-4d90-8e9c-8c1ae2e94026 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:23.938979 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a1f8e3ce-102d-4d90-8e9c-8c1ae2e94026 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:23.938979 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a1f8e3ce-102d-4d90-8e9c-8c1ae2e94026 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:23.938979 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a1f8e3ce-102d-4d90-8e9c-8c1ae2e94026 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:24.092641 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-80ea0e9b-6c5a-4e4c-beb5-37f359eadcad tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:24.102121 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-80ea0e9b-6c5a-4e4c-beb5-37f359eadcad tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:24.103621 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-80ea0e9b-6c5a-4e4c-beb5-37f359eadcad tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:24.104774 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-80ea0e9b-6c5a-4e4c-beb5-37f359eadcad tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1723 microversion: 2.20 time: 0.212861 Jul 12 14:42:24.105345 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 189/385] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:23 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:42:24.121002 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-a1f8e3ce-102d-4d90-8e9c-8c1ae2e94026 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:24.129005 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-a1f8e3ce-102d-4d90-8e9c-8c1ae2e94026 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1724 microversion: 2.1 time: 0.206346 Jul 12 14:42:24.129604 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 197/386] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:23 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:42:25.125543 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-9c5d6c4d-43a2-473d-ae86-a451ad78d7c5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:25.126492 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-9c5d6c4d-43a2-473d-ae86-a451ad78d7c5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:25.136598 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9c5d6c4d-43a2-473d-ae86-a451ad78d7c5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:25.137402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9c5d6c4d-43a2-473d-ae86-a451ad78d7c5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:25.138583 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9c5d6c4d-43a2-473d-ae86-a451ad78d7c5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:25.139252 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9c5d6c4d-43a2-473d-ae86-a451ad78d7c5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:25.146612 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-6d964b44-b170-4c8a-846c-896a4a4d8537 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:25.147827 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-6d964b44-b170-4c8a-846c-896a4a4d8537 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:25.155748 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6d964b44-b170-4c8a-846c-896a4a4d8537 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:25.156519 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6d964b44-b170-4c8a-846c-896a4a4d8537 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:25.158090 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6d964b44-b170-4c8a-846c-896a4a4d8537 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:25.158748 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6d964b44-b170-4c8a-846c-896a4a4d8537 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:25.390361 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-9c5d6c4d-43a2-473d-ae86-a451ad78d7c5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:25.400815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-9c5d6c4d-43a2-473d-ae86-a451ad78d7c5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:25.400815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-9c5d6c4d-43a2-473d-ae86-a451ad78d7c5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:25.401714 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-9c5d6c4d-43a2-473d-ae86-a451ad78d7c5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1723 microversion: 2.20 time: 0.282576 Jul 12 14:42:25.402256 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 190/387] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:25 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:25.403324 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-6d964b44-b170-4c8a-846c-896a4a4d8537 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:25.411958 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-6d964b44-b170-4c8a-846c-896a4a4d8537 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1724 microversion: 2.1 time: 0.269365 Jul 12 14:42:25.412725 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 198/388] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:25 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1724 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:42:26.420146 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-49344085-3b02-4614-8a4d-6fa0a20406a5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:26.420748 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-49344085-3b02-4614-8a4d-6fa0a20406a5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:26.427266 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-49344085-3b02-4614-8a4d-6fa0a20406a5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:26.427713 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-49344085-3b02-4614-8a4d-6fa0a20406a5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:26.428354 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-3987962c-30d9-4b51-bec3-3e25450eef43 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:26.428787 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-49344085-3b02-4614-8a4d-6fa0a20406a5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:26.428885 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-49344085-3b02-4614-8a4d-6fa0a20406a5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:26.429117 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-3987962c-30d9-4b51-bec3-3e25450eef43 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:26.435670 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3987962c-30d9-4b51-bec3-3e25450eef43 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:26.436125 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3987962c-30d9-4b51-bec3-3e25450eef43 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:26.436890 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3987962c-30d9-4b51-bec3-3e25450eef43 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:26.437513 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3987962c-30d9-4b51-bec3-3e25450eef43 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:26.632796 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-3987962c-30d9-4b51-bec3-3e25450eef43 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:26.636009 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-49344085-3b02-4614-8a4d-6fa0a20406a5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:26.641425 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-3987962c-30d9-4b51-bec3-3e25450eef43 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1724 microversion: 2.1 time: 0.216923 Jul 12 14:42:26.644596 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-49344085-3b02-4614-8a4d-6fa0a20406a5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:26.646228 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-49344085-3b02-4614-8a4d-6fa0a20406a5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:26.647598 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-49344085-3b02-4614-8a4d-6fa0a20406a5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1723 microversion: 2.20 time: 0.231417 Jul 12 14:42:26.648212 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 191/389] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:26 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:26.656123 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 199/390] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:26 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:42:27.659172 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-4ebc781b-2e88-49ca-af7b-b7fb2f36c269 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:27.659797 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-4ebc781b-2e88-49ca-af7b-b7fb2f36c269 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:27.665977 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4ebc781b-2e88-49ca-af7b-b7fb2f36c269 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:27.666426 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4ebc781b-2e88-49ca-af7b-b7fb2f36c269 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:27.666806 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-b0a4a139-977c-487f-b166-1a899b3ea87d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:27.667210 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4ebc781b-2e88-49ca-af7b-b7fb2f36c269 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:27.667418 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-b0a4a139-977c-487f-b166-1a899b3ea87d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:27.667596 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4ebc781b-2e88-49ca-af7b-b7fb2f36c269 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:27.669730 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_api:SELECT=60 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:27.674657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b0a4a139-977c-487f-b166-1a899b3ea87d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:27.675278 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b0a4a139-977c-487f-b166-1a899b3ea87d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:27.676077 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b0a4a139-977c-487f-b166-1a899b3ea87d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:27.676641 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b0a4a139-977c-487f-b166-1a899b3ea87d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:27.866205 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-4ebc781b-2e88-49ca-af7b-b7fb2f36c269 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:27.873586 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-b0a4a139-977c-487f-b166-1a899b3ea87d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:27.874694 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-4ebc781b-2e88-49ca-af7b-b7fb2f36c269 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1724 microversion: 2.1 time: 0.219399 Jul 12 14:42:27.875281 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 200/391] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:27 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:27.881844 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-b0a4a139-977c-487f-b166-1a899b3ea87d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:27.883422 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-b0a4a139-977c-487f-b166-1a899b3ea87d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:27.885135 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-b0a4a139-977c-487f-b166-1a899b3ea87d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1744 microversion: 2.20 time: 0.221932 Jul 12 14:42:27.885712 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 192/392] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:27 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1744 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:42:28.891739 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-88545211-bd5a-40da-908e-a200d19f37bf tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:28.892516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-88545211-bd5a-40da-908e-a200d19f37bf tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:28.899388 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-88545211-bd5a-40da-908e-a200d19f37bf tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:28.900693 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-88545211-bd5a-40da-908e-a200d19f37bf tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:28.901594 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-88545211-bd5a-40da-908e-a200d19f37bf tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:28.902030 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-88545211-bd5a-40da-908e-a200d19f37bf tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:28.906763 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-607d841c-bce6-4d22-b4f5-16a86efc9208 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:28.907433 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-607d841c-bce6-4d22-b4f5-16a86efc9208 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:28.913862 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-607d841c-bce6-4d22-b4f5-16a86efc9208 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:28.914317 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-607d841c-bce6-4d22-b4f5-16a86efc9208 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:28.915079 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-607d841c-bce6-4d22-b4f5-16a86efc9208 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:28.915512 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-607d841c-bce6-4d22-b4f5-16a86efc9208 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:29.104697 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-88545211-bd5a-40da-908e-a200d19f37bf tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:29.113080 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-88545211-bd5a-40da-908e-a200d19f37bf tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1724 microversion: 2.1 time: 0.225060 Jul 12 14:42:29.113753 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 201/393] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:28 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:29.115316 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-607d841c-bce6-4d22-b4f5-16a86efc9208 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:29.123588 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-607d841c-bce6-4d22-b4f5-16a86efc9208 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:29.125077 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-607d841c-bce6-4d22-b4f5-16a86efc9208 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:29.126245 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-607d841c-bce6-4d22-b4f5-16a86efc9208 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1744 microversion: 2.20 time: 0.223456 Jul 12 14:42:29.126790 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 193/394] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:28 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1744 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:30.131122 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-2d6e29ac-1de1-4145-b13c-abf9a80a38b5 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:30.136268 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-2d6e29ac-1de1-4145-b13c-abf9a80a38b5 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:30.140266 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2d6e29ac-1de1-4145-b13c-abf9a80a38b5 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:30.141021 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2d6e29ac-1de1-4145-b13c-abf9a80a38b5 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:30.142003 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2d6e29ac-1de1-4145-b13c-abf9a80a38b5 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:30.142436 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2d6e29ac-1de1-4145-b13c-abf9a80a38b5 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:30.144995 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-1716bbec-2c2f-4b1c-a464-389c8250b956 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:30.145878 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-1716bbec-2c2f-4b1c-a464-389c8250b956 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:30.153688 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1716bbec-2c2f-4b1c-a464-389c8250b956 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:30.154289 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1716bbec-2c2f-4b1c-a464-389c8250b956 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:30.155078 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1716bbec-2c2f-4b1c-a464-389c8250b956 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:30.155523 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1716bbec-2c2f-4b1c-a464-389c8250b956 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:30.347865 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-2d6e29ac-1de1-4145-b13c-abf9a80a38b5 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:30.350876 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-1716bbec-2c2f-4b1c-a464-389c8250b956 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:30.357250 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-2d6e29ac-1de1-4145-b13c-abf9a80a38b5 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1724 microversion: 2.1 time: 0.230870 Jul 12 14:42:30.357998 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 202/395] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:30 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:30.359436 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-1716bbec-2c2f-4b1c-a464-389c8250b956 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:30.360937 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-1716bbec-2c2f-4b1c-a464-389c8250b956 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:30.362106 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-1716bbec-2c2f-4b1c-a464-389c8250b956 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1744 microversion: 2.20 time: 0.222232 Jul 12 14:42:30.362703 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 194/396] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:30 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1744 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:42:31.374378 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-b28cfe9c-2384-47e3-a258-b242972e7356 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:31.375932 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-b28cfe9c-2384-47e3-a258-b242972e7356 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:31.378443 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_api:SELECT=54 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:31.380736 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ef73efcd-2447-41d7-8f37-79a46e4be8e7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:31.381946 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-ef73efcd-2447-41d7-8f37-79a46e4be8e7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:31.383691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b28cfe9c-2384-47e3-a258-b242972e7356 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:31.384175 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b28cfe9c-2384-47e3-a258-b242972e7356 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:31.384993 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b28cfe9c-2384-47e3-a258-b242972e7356 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:31.385817 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b28cfe9c-2384-47e3-a258-b242972e7356 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:31.388668 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ef73efcd-2447-41d7-8f37-79a46e4be8e7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:31.389359 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ef73efcd-2447-41d7-8f37-79a46e4be8e7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:31.390329 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ef73efcd-2447-41d7-8f37-79a46e4be8e7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:31.390771 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ef73efcd-2447-41d7-8f37-79a46e4be8e7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:31.609638 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-b28cfe9c-2384-47e3-a258-b242972e7356 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:31.611194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ef73efcd-2447-41d7-8f37-79a46e4be8e7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:31.619966 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-b28cfe9c-2384-47e3-a258-b242972e7356 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1724 microversion: 2.1 time: 0.249467 Jul 12 14:42:31.620933 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 203/397] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:31 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:31.621127 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ef73efcd-2447-41d7-8f37-79a46e4be8e7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:31.622737 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ef73efcd-2447-41d7-8f37-79a46e4be8e7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:31.624010 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ef73efcd-2447-41d7-8f37-79a46e4be8e7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1744 microversion: 2.20 time: 0.247365 Jul 12 14:42:31.626738 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 195/398] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:31 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1744 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:42:32.600083 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-be7f054a-eec5-40cf-9e6f-600fe69e75d2 req-5f39287d-bccc-4341-9b2b-d3d4ec9c40e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26eeea2d-c1c2-46a7-b727-269cf6dce92a", "name": "network-vif-plugged", "status": "completed", "tag": "f0edff70-5e51-412d-b474-2a70b09725f5"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:42:32.626316 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-be7f054a-eec5-40cf-9e6f-600fe69e75d2 req-5f39287d-bccc-4341-9b2b-d3d4ec9c40e2 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:32.637634 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-67b1d420-5d84-485c-a86a-df95153004d2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:32.638333 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-67b1d420-5d84-485c-a86a-df95153004d2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:32.641975 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-be7f054a-eec5-40cf-9e6f-600fe69e75d2 req-5f39287d-bccc-4341-9b2b-d3d4ec9c40e2 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:32.649415 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-67b1d420-5d84-485c-a86a-df95153004d2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:32.651991 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-67b1d420-5d84-485c-a86a-df95153004d2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:32.653372 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-67b1d420-5d84-485c-a86a-df95153004d2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:32.656376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-be7f054a-eec5-40cf-9e6f-600fe69e75d2 req-5f39287d-bccc-4341-9b2b-d3d4ec9c40e2 service nova] Creating event network-vif-plugged:f0edff70-5e51-412d-b474-2a70b09725f5 for instance 26eeea2d-c1c2-46a7-b727-269cf6dce92a on hv-cinder-82002 Jul 12 14:42:32.659851 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-67b1d420-5d84-485c-a86a-df95153004d2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:32.662447 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-be7f054a-eec5-40cf-9e6f-600fe69e75d2 req-5f39287d-bccc-4341-9b2b-d3d4ec9c40e2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069039 Jul 12 14:42:32.663482 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 204/399] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:42:32.665742 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=100 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:32.670321 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-fba217be-1bd8-45ed-b2fa-734c45c7d62b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:32.671161 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-fba217be-1bd8-45ed-b2fa-734c45c7d62b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:32.678956 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fba217be-1bd8-45ed-b2fa-734c45c7d62b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:32.679700 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fba217be-1bd8-45ed-b2fa-734c45c7d62b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:32.680784 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fba217be-1bd8-45ed-b2fa-734c45c7d62b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:32.682076 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fba217be-1bd8-45ed-b2fa-734c45c7d62b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:32.938519 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-67b1d420-5d84-485c-a86a-df95153004d2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:32.956002 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-67b1d420-5d84-485c-a86a-df95153004d2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1724 microversion: 2.1 time: 0.322593 Jul 12 14:42:32.957718 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 196/400] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:32 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1724 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:32.968648 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-fba217be-1bd8-45ed-b2fa-734c45c7d62b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:32.979567 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-fba217be-1bd8-45ed-b2fa-734c45c7d62b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:32.981556 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-fba217be-1bd8-45ed-b2fa-734c45c7d62b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:32.984067 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-fba217be-1bd8-45ed-b2fa-734c45c7d62b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1739 microversion: 2.20 time: 0.318441 Jul 12 14:42:32.994294 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 205/401] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:32 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1739 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:33.974461 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-5c989203-3b44-4a35-aab1-ba91dec20401 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:33.976174 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-5c989203-3b44-4a35-aab1-ba91dec20401 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:33.984163 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5c989203-3b44-4a35-aab1-ba91dec20401 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:33.984865 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5c989203-3b44-4a35-aab1-ba91dec20401 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:33.985754 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5c989203-3b44-4a35-aab1-ba91dec20401 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:33.986386 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5c989203-3b44-4a35-aab1-ba91dec20401 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:34.004883 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-6f3a1f04-d5cf-4b24-933d-7342ec039e73 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:34.006349 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-6f3a1f04-d5cf-4b24-933d-7342ec039e73 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:34.018080 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6f3a1f04-d5cf-4b24-933d-7342ec039e73 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:34.018462 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6f3a1f04-d5cf-4b24-933d-7342ec039e73 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:34.019241 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6f3a1f04-d5cf-4b24-933d-7342ec039e73 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:34.019682 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6f3a1f04-d5cf-4b24-933d-7342ec039e73 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:34.263984 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-5c989203-3b44-4a35-aab1-ba91dec20401 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:34.273110 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-5c989203-3b44-4a35-aab1-ba91dec20401 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1724 microversion: 2.1 time: 0.302749 Jul 12 14:42:34.277201 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-6f3a1f04-d5cf-4b24-933d-7342ec039e73 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:34.280507 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 197/402] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:33 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1724 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:34.288432 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=100 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:34.293395 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-6f3a1f04-d5cf-4b24-933d-7342ec039e73 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:34.294899 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-6f3a1f04-d5cf-4b24-933d-7342ec039e73 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:34.296040 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-6f3a1f04-d5cf-4b24-933d-7342ec039e73 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1739 microversion: 2.20 time: 0.295442 Jul 12 14:42:34.296583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 206/403] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:33 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1739 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:35.293977 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-fc83a601-b8a5-4d61-b5a2-529324aed5c6 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:35.294541 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-fc83a601-b8a5-4d61-b5a2-529324aed5c6 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:35.301222 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fc83a601-b8a5-4d61-b5a2-529324aed5c6 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:35.301680 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fc83a601-b8a5-4d61-b5a2-529324aed5c6 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:35.302444 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fc83a601-b8a5-4d61-b5a2-529324aed5c6 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:35.302882 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fc83a601-b8a5-4d61-b5a2-529324aed5c6 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:35.326157 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-2b02cc9a-775f-4c4b-b01f-5d6a007d3b00 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:35.326827 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-2b02cc9a-775f-4c4b-b01f-5d6a007d3b00 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:35.333627 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2b02cc9a-775f-4c4b-b01f-5d6a007d3b00 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:35.334084 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2b02cc9a-775f-4c4b-b01f-5d6a007d3b00 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:35.334869 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2b02cc9a-775f-4c4b-b01f-5d6a007d3b00 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:35.335309 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2b02cc9a-775f-4c4b-b01f-5d6a007d3b00 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:35.502924 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-fc83a601-b8a5-4d61-b5a2-529324aed5c6 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:35.516230 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-fc83a601-b8a5-4d61-b5a2-529324aed5c6 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1701 microversion: 2.1 time: 0.226581 Jul 12 14:42:35.530821 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 198/404] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:35 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1701 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:35.532036 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-2b02cc9a-775f-4c4b-b01f-5d6a007d3b00 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:35.536852 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-d3a762c2-20c7-4858-a51b-8b5b1d913a85 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:42:35.547651 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d3a762c2-20c7-4858-a51b-8b5b1d913a85 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:35.548302 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d3a762c2-20c7-4858-a51b-8b5b1d913a85 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:35.558322 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-2b02cc9a-775f-4c4b-b01f-5d6a007d3b00 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:35.563626 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-2b02cc9a-775f-4c4b-b01f-5d6a007d3b00 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:35.567406 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-2b02cc9a-775f-4c4b-b01f-5d6a007d3b00 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1739 microversion: 2.20 time: 0.256411 Jul 12 14:42:35.568203 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 207/405] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:35 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1739 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:42:35.671700 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-d3a762c2-20c7-4858-a51b-8b5b1d913a85 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Going to try to start instance {{(pid=129980) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 12 14:42:35.862594 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-d3a762c2-20c7-4858-a51b-8b5b1d913a85 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "POST /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560/action" status: 202 len: 0 microversion: 2.1 time: 0.330290 Jul 12 14:42:35.863399 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 199/406] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Jul 12 14:42:35 2022] POST /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:42:35.873073 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-56c6ab66-76bc-48fc-bfe2-a62c2ffcfa9a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:35.873716 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-56c6ab66-76bc-48fc-bfe2-a62c2ffcfa9a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:35.885012 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-56c6ab66-76bc-48fc-bfe2-a62c2ffcfa9a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:35.885789 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-56c6ab66-76bc-48fc-bfe2-a62c2ffcfa9a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:35.886574 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-56c6ab66-76bc-48fc-bfe2-a62c2ffcfa9a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:35.887004 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-56c6ab66-76bc-48fc-bfe2-a62c2ffcfa9a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:36.066792 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-56c6ab66-76bc-48fc-bfe2-a62c2ffcfa9a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:36.075779 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-56c6ab66-76bc-48fc-bfe2-a62c2ffcfa9a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1710 microversion: 2.1 time: 0.207319 Jul 12 14:42:36.076691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 208/407] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:35 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1710 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:36.590038 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-e96b1a1b-f1d1-4b05-8012-78d639d6faf5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:36.591563 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-e96b1a1b-f1d1-4b05-8012-78d639d6faf5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:36.599225 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e96b1a1b-f1d1-4b05-8012-78d639d6faf5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:36.608021 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e96b1a1b-f1d1-4b05-8012-78d639d6faf5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:36.608021 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e96b1a1b-f1d1-4b05-8012-78d639d6faf5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:36.608021 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e96b1a1b-f1d1-4b05-8012-78d639d6faf5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:36.886348 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-e96b1a1b-f1d1-4b05-8012-78d639d6faf5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:36.896697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-e96b1a1b-f1d1-4b05-8012-78d639d6faf5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:36.898613 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-e96b1a1b-f1d1-4b05-8012-78d639d6faf5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:36.899813 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-e96b1a1b-f1d1-4b05-8012-78d639d6faf5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1739 microversion: 2.20 time: 0.316266 Jul 12 14:42:36.903404 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 200/408] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:36 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1739 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:42:37.093774 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-71294d87-cc0e-407f-ad0b-fce5cf936338 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:37.094596 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-71294d87-cc0e-407f-ad0b-fce5cf936338 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:37.103963 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-71294d87-cc0e-407f-ad0b-fce5cf936338 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:37.104443 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-71294d87-cc0e-407f-ad0b-fce5cf936338 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:37.105521 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-71294d87-cc0e-407f-ad0b-fce5cf936338 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:37.106189 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-71294d87-cc0e-407f-ad0b-fce5cf936338 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:37.279002 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-71294d87-cc0e-407f-ad0b-fce5cf936338 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:37.289528 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-71294d87-cc0e-407f-ad0b-fce5cf936338 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1710 microversion: 2.1 time: 0.200422 Jul 12 14:42:37.291297 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 209/409] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:37 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1710 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:37.924355 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-cf20a5a0-f3bc-4716-a723-1f7ff6b3cdc9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:37.925572 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-cf20a5a0-f3bc-4716-a723-1f7ff6b3cdc9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:37.938001 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-cf20a5a0-f3bc-4716-a723-1f7ff6b3cdc9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:37.938775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-cf20a5a0-f3bc-4716-a723-1f7ff6b3cdc9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:37.940326 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-cf20a5a0-f3bc-4716-a723-1f7ff6b3cdc9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:37.940994 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-cf20a5a0-f3bc-4716-a723-1f7ff6b3cdc9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:38.208310 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-cf20a5a0-f3bc-4716-a723-1f7ff6b3cdc9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:38.217282 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-cf20a5a0-f3bc-4716-a723-1f7ff6b3cdc9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:38.219013 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-cf20a5a0-f3bc-4716-a723-1f7ff6b3cdc9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:38.220185 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-cf20a5a0-f3bc-4716-a723-1f7ff6b3cdc9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1739 microversion: 2.20 time: 0.299815 Jul 12 14:42:38.233469 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 201/410] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:37 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1739 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:38.311075 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-8d630926-430c-41d5-bd06-2a79a6f666ea tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:38.311689 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-8d630926-430c-41d5-bd06-2a79a6f666ea tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:38.322474 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8d630926-430c-41d5-bd06-2a79a6f666ea tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:38.322942 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8d630926-430c-41d5-bd06-2a79a6f666ea tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:38.323751 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8d630926-430c-41d5-bd06-2a79a6f666ea tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:38.324184 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8d630926-430c-41d5-bd06-2a79a6f666ea tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:38.517937 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-8d630926-430c-41d5-bd06-2a79a6f666ea tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:38.527333 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-8d630926-430c-41d5-bd06-2a79a6f666ea tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1714 microversion: 2.1 time: 0.220584 Jul 12 14:42:38.528371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 210/411] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:38 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1714 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:39.241124 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-96240bb2-83fd-46f1-b29e-a8ad0bce4e92 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:39.246692 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-96240bb2-83fd-46f1-b29e-a8ad0bce4e92 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:39.256274 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-96240bb2-83fd-46f1-b29e-a8ad0bce4e92 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:39.256735 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-96240bb2-83fd-46f1-b29e-a8ad0bce4e92 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:39.257555 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-96240bb2-83fd-46f1-b29e-a8ad0bce4e92 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:39.257995 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-96240bb2-83fd-46f1-b29e-a8ad0bce4e92 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:39.424688 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-96240bb2-83fd-46f1-b29e-a8ad0bce4e92 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:39.434076 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-96240bb2-83fd-46f1-b29e-a8ad0bce4e92 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:39.435606 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-96240bb2-83fd-46f1-b29e-a8ad0bce4e92 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:39.436771 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-96240bb2-83fd-46f1-b29e-a8ad0bce4e92 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1739 microversion: 2.20 time: 0.200782 Jul 12 14:42:39.446260 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 202/412] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:39 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:40.458818 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-b9d29c76-3ba5-444b-b392-a6dd09b405b9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:40.459926 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-b9d29c76-3ba5-444b-b392-a6dd09b405b9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:40.467446 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b9d29c76-3ba5-444b-b392-a6dd09b405b9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:40.468049 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b9d29c76-3ba5-444b-b392-a6dd09b405b9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:40.468838 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b9d29c76-3ba5-444b-b392-a6dd09b405b9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:40.469477 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b9d29c76-3ba5-444b-b392-a6dd09b405b9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:40.674106 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-b9d29c76-3ba5-444b-b392-a6dd09b405b9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:40.685214 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-b9d29c76-3ba5-444b-b392-a6dd09b405b9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:40.687399 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-b9d29c76-3ba5-444b-b392-a6dd09b405b9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:40.688009 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-b9d29c76-3ba5-444b-b392-a6dd09b405b9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1739 microversion: 2.20 time: 0.235548 Jul 12 14:42:40.688570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 211/413] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:40 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1739 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:42:41.713815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ec30f312-8184-4a4d-b0fa-3cbe110d585a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:41.713815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-ec30f312-8184-4a4d-b0fa-3cbe110d585a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:41.717604 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ec30f312-8184-4a4d-b0fa-3cbe110d585a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:41.717947 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ec30f312-8184-4a4d-b0fa-3cbe110d585a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:41.718730 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ec30f312-8184-4a4d-b0fa-3cbe110d585a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:41.719175 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ec30f312-8184-4a4d-b0fa-3cbe110d585a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:41.900915 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ec30f312-8184-4a4d-b0fa-3cbe110d585a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:41.910707 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ec30f312-8184-4a4d-b0fa-3cbe110d585a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:41.912515 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ec30f312-8184-4a4d-b0fa-3cbe110d585a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:41.913714 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ec30f312-8184-4a4d-b0fa-3cbe110d585a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1739 microversion: 2.20 time: 0.210620 Jul 12 14:42:41.914280 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 203/414] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:41 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:42.935766 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-5b39b5d2-3cc5-4d47-a66e-9412ac2d59ff tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:42.937944 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-5b39b5d2-3cc5-4d47-a66e-9412ac2d59ff tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:42.945683 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5b39b5d2-3cc5-4d47-a66e-9412ac2d59ff tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:42.946405 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5b39b5d2-3cc5-4d47-a66e-9412ac2d59ff tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:42.947900 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5b39b5d2-3cc5-4d47-a66e-9412ac2d59ff tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:42.948511 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5b39b5d2-3cc5-4d47-a66e-9412ac2d59ff tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:43.106579 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-5b39b5d2-3cc5-4d47-a66e-9412ac2d59ff tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:43.115759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-5b39b5d2-3cc5-4d47-a66e-9412ac2d59ff tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:43.117296 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-5b39b5d2-3cc5-4d47-a66e-9412ac2d59ff tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:43.118494 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-5b39b5d2-3cc5-4d47-a66e-9412ac2d59ff tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1739 microversion: 2.20 time: 0.187842 Jul 12 14:42:43.119340 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 212/415] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:42 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:44.136589 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-533924ae-defd-428c-bf71-c10f2822b8d2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:44.137137 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-533924ae-defd-428c-bf71-c10f2822b8d2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:44.143927 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-533924ae-defd-428c-bf71-c10f2822b8d2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:44.144384 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-533924ae-defd-428c-bf71-c10f2822b8d2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:44.145147 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-533924ae-defd-428c-bf71-c10f2822b8d2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:44.145646 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-533924ae-defd-428c-bf71-c10f2822b8d2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:44.272825 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-533924ae-defd-428c-bf71-c10f2822b8d2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:44.281229 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-533924ae-defd-428c-bf71-c10f2822b8d2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:44.282739 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-533924ae-defd-428c-bf71-c10f2822b8d2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:44.283888 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-533924ae-defd-428c-bf71-c10f2822b8d2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1739 microversion: 2.20 time: 0.151253 Jul 12 14:42:44.284447 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 204/416] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:44 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1739 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:45.302733 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-23b2afce-1bb6-4299-8284-3ce44b413b68 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:45.303428 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-23b2afce-1bb6-4299-8284-3ce44b413b68 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:45.310314 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-23b2afce-1bb6-4299-8284-3ce44b413b68 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:45.310923 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-23b2afce-1bb6-4299-8284-3ce44b413b68 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:45.311502 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-23b2afce-1bb6-4299-8284-3ce44b413b68 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:45.311933 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-23b2afce-1bb6-4299-8284-3ce44b413b68 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:45.446206 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-23b2afce-1bb6-4299-8284-3ce44b413b68 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:45.454698 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-23b2afce-1bb6-4299-8284-3ce44b413b68 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:45.456191 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-23b2afce-1bb6-4299-8284-3ce44b413b68 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:45.457378 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-23b2afce-1bb6-4299-8284-3ce44b413b68 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1739 microversion: 2.20 time: 0.158756 Jul 12 14:42:45.457932 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 213/417] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:45 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:46.475829 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-2c1104b1-45eb-4cae-8665-cb59da155bc9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:46.476430 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-2c1104b1-45eb-4cae-8665-cb59da155bc9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:46.483588 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2c1104b1-45eb-4cae-8665-cb59da155bc9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:46.484034 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2c1104b1-45eb-4cae-8665-cb59da155bc9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:46.484784 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2c1104b1-45eb-4cae-8665-cb59da155bc9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:46.485243 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2c1104b1-45eb-4cae-8665-cb59da155bc9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:46.612870 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-2c1104b1-45eb-4cae-8665-cb59da155bc9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:46.620988 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-2c1104b1-45eb-4cae-8665-cb59da155bc9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:46.622547 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-2c1104b1-45eb-4cae-8665-cb59da155bc9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:46.623704 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-2c1104b1-45eb-4cae-8665-cb59da155bc9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1739 microversion: 2.20 time: 0.151786 Jul 12 14:42:46.624319 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 205/418] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:46 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:47.641371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-ad744a55-e04f-45ed-b0d1-4006e109bed5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:47.642131 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-ad744a55-e04f-45ed-b0d1-4006e109bed5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:47.648894 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ad744a55-e04f-45ed-b0d1-4006e109bed5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:47.649386 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ad744a55-e04f-45ed-b0d1-4006e109bed5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:47.650156 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ad744a55-e04f-45ed-b0d1-4006e109bed5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:47.650595 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ad744a55-e04f-45ed-b0d1-4006e109bed5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:47.788018 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-ad744a55-e04f-45ed-b0d1-4006e109bed5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:47.796548 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-ad744a55-e04f-45ed-b0d1-4006e109bed5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:47.798057 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-ad744a55-e04f-45ed-b0d1-4006e109bed5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:47.799188 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-ad744a55-e04f-45ed-b0d1-4006e109bed5 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1721 microversion: 2.20 time: 0.161880 Jul 12 14:42:47.801896 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 214/419] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:47 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:48.816938 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-d92d167c-b635-48bd-88a6-7cfbe51a406a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:48.817585 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-d92d167c-b635-48bd-88a6-7cfbe51a406a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:48.824031 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d92d167c-b635-48bd-88a6-7cfbe51a406a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:48.824489 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d92d167c-b635-48bd-88a6-7cfbe51a406a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:48.825275 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d92d167c-b635-48bd-88a6-7cfbe51a406a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:48.825715 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d92d167c-b635-48bd-88a6-7cfbe51a406a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:48.962322 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-d92d167c-b635-48bd-88a6-7cfbe51a406a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:48.970816 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-d92d167c-b635-48bd-88a6-7cfbe51a406a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:48.974094 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-d92d167c-b635-48bd-88a6-7cfbe51a406a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:48.974094 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-d92d167c-b635-48bd-88a6-7cfbe51a406a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1721 microversion: 2.20 time: 0.160418 Jul 12 14:42:48.977352 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 206/420] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:48 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:49.992111 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-fad17be0-f70a-4826-9327-e19b086f1412 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:49.992629 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-fad17be0-f70a-4826-9327-e19b086f1412 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:49.999895 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fad17be0-f70a-4826-9327-e19b086f1412 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:50.000346 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fad17be0-f70a-4826-9327-e19b086f1412 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:50.001100 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fad17be0-f70a-4826-9327-e19b086f1412 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:50.001557 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fad17be0-f70a-4826-9327-e19b086f1412 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:50.140515 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-fad17be0-f70a-4826-9327-e19b086f1412 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:50.149023 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-fad17be0-f70a-4826-9327-e19b086f1412 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:50.150558 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-fad17be0-f70a-4826-9327-e19b086f1412 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:50.151758 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-fad17be0-f70a-4826-9327-e19b086f1412 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1721 microversion: 2.20 time: 0.163989 Jul 12 14:42:50.152360 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 215/421] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:49 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:50.635099 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-a59e1aa2-5dbe-4eaa-b17c-2807c81fc670 req-c07b9b8a-46f5-4ef0-80a9-4527249aaafa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26eeea2d-c1c2-46a7-b727-269cf6dce92a", "name": "network-vif-unplugged", "status": "completed", "tag": "f0edff70-5e51-412d-b474-2a70b09725f5"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:42:50.645812 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-a59e1aa2-5dbe-4eaa-b17c-2807c81fc670 req-c07b9b8a-46f5-4ef0-80a9-4527249aaafa service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:50.646718 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-a59e1aa2-5dbe-4eaa-b17c-2807c81fc670 req-c07b9b8a-46f5-4ef0-80a9-4527249aaafa service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:50.663117 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-a59e1aa2-5dbe-4eaa-b17c-2807c81fc670 req-c07b9b8a-46f5-4ef0-80a9-4527249aaafa service nova] Creating event network-vif-unplugged:f0edff70-5e51-412d-b474-2a70b09725f5 for instance 26eeea2d-c1c2-46a7-b727-269cf6dce92a on hv-cinder-82002 Jul 12 14:42:50.669848 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-a59e1aa2-5dbe-4eaa-b17c-2807c81fc670 req-c07b9b8a-46f5-4ef0-80a9-4527249aaafa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038527 Jul 12 14:42:50.670448 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 207/422] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:42:51.170224 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-bd499b1f-be07-4a25-a396-4a4f02624c71 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:51.170829 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-bd499b1f-be07-4a25-a396-4a4f02624c71 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:51.177409 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bd499b1f-be07-4a25-a396-4a4f02624c71 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:51.177864 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bd499b1f-be07-4a25-a396-4a4f02624c71 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:51.178628 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bd499b1f-be07-4a25-a396-4a4f02624c71 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:51.179061 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bd499b1f-be07-4a25-a396-4a4f02624c71 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:51.312244 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-bd499b1f-be07-4a25-a396-4a4f02624c71 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:51.320113 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-bd499b1f-be07-4a25-a396-4a4f02624c71 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:51.321637 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-bd499b1f-be07-4a25-a396-4a4f02624c71 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:51.322849 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-bd499b1f-be07-4a25-a396-4a4f02624c71 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1724 microversion: 2.20 time: 0.156662 Jul 12 14:42:51.323408 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 216/423] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:51 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:51.341790 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-33301549-0e15-4494-8b3c-0e9478d8e626 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e95dfbf-d45a-4b9c-906b-b0a76306cd18"}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:42:51.342902 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-33301549-0e15-4494-8b3c-0e9478d8e626 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:51.349136 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-33301549-0e15-4494-8b3c-0e9478d8e626 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:51.349612 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-33301549-0e15-4494-8b3c-0e9478d8e626 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:51.350362 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-33301549-0e15-4494-8b3c-0e9478d8e626 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:51.350790 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-33301549-0e15-4494-8b3c-0e9478d8e626 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:52.342707 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-33301549-0e15-4494-8b3c-0e9478d8e626 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "POST /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.005891 Jul 12 14:42:52.343301 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 208/424] 10.222.0.30 () {62 vars in 1363 bytes} [Tue Jul 12 14:42:51 2022] POST /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a/os-volume_attachments => generated 188 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:42:52.613106 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-a4c42e25-cd6a-4411-9c71-d51fc0e89dcd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:42:52.613795 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-a4c42e25-cd6a-4411-9c71-d51fc0e89dcd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:52.620659 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a4c42e25-cd6a-4411-9c71-d51fc0e89dcd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:52.621691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a4c42e25-cd6a-4411-9c71-d51fc0e89dcd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:52.626097 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a4c42e25-cd6a-4411-9c71-d51fc0e89dcd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:52.626097 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a4c42e25-cd6a-4411-9c71-d51fc0e89dcd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:52.876903 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-a4c42e25-cd6a-4411-9c71-d51fc0e89dcd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "POST /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a/action" status: 202 len: 0 microversion: 2.20 time: 0.267539 Jul 12 14:42:52.877504 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 217/425] 10.222.0.30 () {62 vars in 1318 bytes} [Tue Jul 12 14:42:52 2022] POST /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:42:52.885784 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-6208e382-a6be-4ef0-892e-4d9bfb1cdbf1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:52.886388 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-6208e382-a6be-4ef0-892e-4d9bfb1cdbf1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:52.893873 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6208e382-a6be-4ef0-892e-4d9bfb1cdbf1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:52.898481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6208e382-a6be-4ef0-892e-4d9bfb1cdbf1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:52.898481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6208e382-a6be-4ef0-892e-4d9bfb1cdbf1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:52.898481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6208e382-a6be-4ef0-892e-4d9bfb1cdbf1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:53.025435 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-6208e382-a6be-4ef0-892e-4d9bfb1cdbf1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:53.030275 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:53.035179 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-6208e382-a6be-4ef0-892e-4d9bfb1cdbf1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:53.036663 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-6208e382-a6be-4ef0-892e-4d9bfb1cdbf1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:53.038070 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-6208e382-a6be-4ef0-892e-4d9bfb1cdbf1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1750 microversion: 2.20 time: 0.156096 Jul 12 14:42:53.038629 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 209/426] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:52 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1750 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:54.057421 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-7dca846e-c617-476d-a21e-de25b48b68c9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:54.058022 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-7dca846e-c617-476d-a21e-de25b48b68c9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:54.064867 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7dca846e-c617-476d-a21e-de25b48b68c9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:54.065521 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7dca846e-c617-476d-a21e-de25b48b68c9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:54.066375 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7dca846e-c617-476d-a21e-de25b48b68c9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:54.066806 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7dca846e-c617-476d-a21e-de25b48b68c9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:54.198679 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7dca846e-c617-476d-a21e-de25b48b68c9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:54.209040 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7dca846e-c617-476d-a21e-de25b48b68c9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:54.210653 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7dca846e-c617-476d-a21e-de25b48b68c9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:54.211802 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-7dca846e-c617-476d-a21e-de25b48b68c9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1750 microversion: 2.20 time: 0.158804 Jul 12 14:42:54.212361 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 218/427] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:54 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1750 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:55.231128 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-90c5902e-85ac-43ff-b4e8-e29ef5abbd52 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:55.232306 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-90c5902e-85ac-43ff-b4e8-e29ef5abbd52 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:55.239187 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-90c5902e-85ac-43ff-b4e8-e29ef5abbd52 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:55.239636 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-90c5902e-85ac-43ff-b4e8-e29ef5abbd52 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:55.240395 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-90c5902e-85ac-43ff-b4e8-e29ef5abbd52 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:55.240834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-90c5902e-85ac-43ff-b4e8-e29ef5abbd52 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:55.366255 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-90c5902e-85ac-43ff-b4e8-e29ef5abbd52 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:55.374754 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-90c5902e-85ac-43ff-b4e8-e29ef5abbd52 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:55.376347 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-90c5902e-85ac-43ff-b4e8-e29ef5abbd52 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:55.377524 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-90c5902e-85ac-43ff-b4e8-e29ef5abbd52 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1750 microversion: 2.20 time: 0.150707 Jul 12 14:42:55.378103 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 210/428] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:55 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1750 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:56.395818 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-69db2994-4028-4d09-abcd-cdf9b4bd28bd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:56.396349 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-69db2994-4028-4d09-abcd-cdf9b4bd28bd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:56.402955 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-69db2994-4028-4d09-abcd-cdf9b4bd28bd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:56.403422 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-69db2994-4028-4d09-abcd-cdf9b4bd28bd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:56.404162 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-69db2994-4028-4d09-abcd-cdf9b4bd28bd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:56.404621 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-69db2994-4028-4d09-abcd-cdf9b4bd28bd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:56.536322 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-69db2994-4028-4d09-abcd-cdf9b4bd28bd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:56.543438 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-69db2994-4028-4d09-abcd-cdf9b4bd28bd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:56.545523 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-69db2994-4028-4d09-abcd-cdf9b4bd28bd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:56.546697 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-69db2994-4028-4d09-abcd-cdf9b4bd28bd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1752 microversion: 2.20 time: 0.154859 Jul 12 14:42:56.547255 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 219/429] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:56 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:57.567170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-3cb5df3f-e07c-4220-8ac0-f7533d2fab2a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:57.567918 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-3cb5df3f-e07c-4220-8ac0-f7533d2fab2a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:57.575313 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3cb5df3f-e07c-4220-8ac0-f7533d2fab2a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:57.576331 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3cb5df3f-e07c-4220-8ac0-f7533d2fab2a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:57.577196 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3cb5df3f-e07c-4220-8ac0-f7533d2fab2a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:57.577641 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3cb5df3f-e07c-4220-8ac0-f7533d2fab2a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:57.707002 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-3cb5df3f-e07c-4220-8ac0-f7533d2fab2a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:57.716105 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-3cb5df3f-e07c-4220-8ac0-f7533d2fab2a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:57.717658 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-3cb5df3f-e07c-4220-8ac0-f7533d2fab2a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:57.718813 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-3cb5df3f-e07c-4220-8ac0-f7533d2fab2a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1752 microversion: 2.20 time: 0.155765 Jul 12 14:42:57.719370 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 211/430] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:57 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:42:58.737497 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-cb57f0c6-53d8-4f16-ac90-6ed35fca9b13 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:58.738137 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-cb57f0c6-53d8-4f16-ac90-6ed35fca9b13 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:58.745078 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-cb57f0c6-53d8-4f16-ac90-6ed35fca9b13 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:58.748082 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-cb57f0c6-53d8-4f16-ac90-6ed35fca9b13 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:58.748082 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-cb57f0c6-53d8-4f16-ac90-6ed35fca9b13 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:58.748082 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-cb57f0c6-53d8-4f16-ac90-6ed35fca9b13 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:58.961735 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-cb57f0c6-53d8-4f16-ac90-6ed35fca9b13 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:58.971790 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-cb57f0c6-53d8-4f16-ac90-6ed35fca9b13 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:58.973305 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-cb57f0c6-53d8-4f16-ac90-6ed35fca9b13 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:58.974487 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-cb57f0c6-53d8-4f16-ac90-6ed35fca9b13 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1808 microversion: 2.20 time: 0.241005 Jul 12 14:42:58.975039 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 220/431] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:58 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1808 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:42:59.811983 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-26787321-bcd3-4edc-97c2-e61525a2c981 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:42:59.813365 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-26787321-bcd3-4edc-97c2-e61525a2c981 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:59.815973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_api:SELECT=40 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:59.822022 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-26787321-bcd3-4edc-97c2-e61525a2c981 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:59.822466 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-26787321-bcd3-4edc-97c2-e61525a2c981 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:59.823327 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-26787321-bcd3-4edc-97c2-e61525a2c981 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:59.823774 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-26787321-bcd3-4edc-97c2-e61525a2c981 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:59.995035 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-0a19068a-307e-4ebd-8d34-24ca710e7645 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:59.995677 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-0a19068a-307e-4ebd-8d34-24ca710e7645 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:00.005963 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0a19068a-307e-4ebd-8d34-24ca710e7645 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:00.006465 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0a19068a-307e-4ebd-8d34-24ca710e7645 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:00.007554 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0a19068a-307e-4ebd-8d34-24ca710e7645 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:00.008150 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0a19068a-307e-4ebd-8d34-24ca710e7645 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:00.033539 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-26787321-bcd3-4edc-97c2-e61525a2c981 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "POST /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca/action" status: 202 len: 0 microversion: 2.1 time: 0.225555 Jul 12 14:43:00.034468 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 212/432] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Jul 12 14:42:59 2022] POST /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:43:00.055923 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-f7edd7c3-e970-4a2c-8bba-d33042b376c7 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:00.061719 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-f7edd7c3-e970-4a2c-8bba-d33042b376c7 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:00.080364 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f7edd7c3-e970-4a2c-8bba-d33042b376c7 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:00.080823 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f7edd7c3-e970-4a2c-8bba-d33042b376c7 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:00.081674 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f7edd7c3-e970-4a2c-8bba-d33042b376c7 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:00.082122 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f7edd7c3-e970-4a2c-8bba-d33042b376c7 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:00.299953 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-0a19068a-307e-4ebd-8d34-24ca710e7645 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:00.313234 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-0a19068a-307e-4ebd-8d34-24ca710e7645 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:00.315004 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-0a19068a-307e-4ebd-8d34-24ca710e7645 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:00.316361 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-0a19068a-307e-4ebd-8d34-24ca710e7645 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1808 microversion: 2.20 time: 0.326066 Jul 12 14:43:00.319834 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 221/433] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:42:59 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1808 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:43:00.362620 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-f7edd7c3-e970-4a2c-8bba-d33042b376c7 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:00.380807 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-f7edd7c3-e970-4a2c-8bba-d33042b376c7 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1749 microversion: 2.1 time: 0.341203 Jul 12 14:43:00.381741 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 213/434] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:00 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1749 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:01.337677 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-6d779a0e-1fcf-4adc-b31d-14fbefd81ea6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:01.338286 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-6d779a0e-1fcf-4adc-b31d-14fbefd81ea6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:01.345671 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6d779a0e-1fcf-4adc-b31d-14fbefd81ea6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:01.346125 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6d779a0e-1fcf-4adc-b31d-14fbefd81ea6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:01.346913 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6d779a0e-1fcf-4adc-b31d-14fbefd81ea6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:01.347351 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6d779a0e-1fcf-4adc-b31d-14fbefd81ea6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:01.368558 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:01.399030 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ff474228-98f9-4171-a0b7-91ea5017fc3f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:01.399650 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-ff474228-98f9-4171-a0b7-91ea5017fc3f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:01.406943 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ff474228-98f9-4171-a0b7-91ea5017fc3f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:01.410362 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ff474228-98f9-4171-a0b7-91ea5017fc3f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:01.410362 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ff474228-98f9-4171-a0b7-91ea5017fc3f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:01.410362 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ff474228-98f9-4171-a0b7-91ea5017fc3f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:01.594059 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-6d779a0e-1fcf-4adc-b31d-14fbefd81ea6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:01.607383 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-6d779a0e-1fcf-4adc-b31d-14fbefd81ea6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:01.609287 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-6d779a0e-1fcf-4adc-b31d-14fbefd81ea6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:01.610680 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-6d779a0e-1fcf-4adc-b31d-14fbefd81ea6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1808 microversion: 2.20 time: 0.276978 Jul 12 14:43:01.612110 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 222/435] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:43:01 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1808 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:43:01.672519 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ff474228-98f9-4171-a0b7-91ea5017fc3f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:01.682156 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ff474228-98f9-4171-a0b7-91ea5017fc3f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1749 microversion: 2.1 time: 0.286834 Jul 12 14:43:01.683409 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 214/436] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:01 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1749 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:02.641393 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-73dffec0-b38f-4498-b66b-a758cfbb639a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:02.642195 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-73dffec0-b38f-4498-b66b-a758cfbb639a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:02.644180 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_api:SELECT=42 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:02.655409 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-73dffec0-b38f-4498-b66b-a758cfbb639a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:02.655722 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-73dffec0-b38f-4498-b66b-a758cfbb639a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:02.659091 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-73dffec0-b38f-4498-b66b-a758cfbb639a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:02.659992 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-73dffec0-b38f-4498-b66b-a758cfbb639a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:02.700689 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-2ebe73ed-3f1b-46b9-a7ec-d88463f4c1bd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:02.701539 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-2ebe73ed-3f1b-46b9-a7ec-d88463f4c1bd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:02.713096 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2ebe73ed-3f1b-46b9-a7ec-d88463f4c1bd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:02.714161 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2ebe73ed-3f1b-46b9-a7ec-d88463f4c1bd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:02.717216 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2ebe73ed-3f1b-46b9-a7ec-d88463f4c1bd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:02.719771 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2ebe73ed-3f1b-46b9-a7ec-d88463f4c1bd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:02.897934 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-73dffec0-b38f-4498-b66b-a758cfbb639a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:02.907354 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-73dffec0-b38f-4498-b66b-a758cfbb639a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:02.908875 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-73dffec0-b38f-4498-b66b-a758cfbb639a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:02.910201 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-73dffec0-b38f-4498-b66b-a758cfbb639a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1808 microversion: 2.20 time: 0.283069 Jul 12 14:43:02.910704 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 223/437] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:43:02 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1808 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:43:02.960499 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-2ebe73ed-3f1b-46b9-a7ec-d88463f4c1bd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:02.968483 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-2ebe73ed-3f1b-46b9-a7ec-d88463f4c1bd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1749 microversion: 2.1 time: 0.272562 Jul 12 14:43:02.969260 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 215/438] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:02 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1749 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:03.932659 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-a2603a72-503b-4386-952c-b6a52a2c4248 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:03.934075 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-a2603a72-503b-4386-952c-b6a52a2c4248 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:03.942728 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a2603a72-503b-4386-952c-b6a52a2c4248 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:03.943400 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a2603a72-503b-4386-952c-b6a52a2c4248 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:03.945311 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a2603a72-503b-4386-952c-b6a52a2c4248 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:03.945311 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a2603a72-503b-4386-952c-b6a52a2c4248 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:03.986711 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-1d7b30d3-c2ee-4a65-ac88-1b79aa917f1c tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:03.987374 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-1d7b30d3-c2ee-4a65-ac88-1b79aa917f1c tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:03.994342 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1d7b30d3-c2ee-4a65-ac88-1b79aa917f1c tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:03.998581 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1d7b30d3-c2ee-4a65-ac88-1b79aa917f1c tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:03.998581 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1d7b30d3-c2ee-4a65-ac88-1b79aa917f1c tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:03.998581 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1d7b30d3-c2ee-4a65-ac88-1b79aa917f1c tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:04.202436 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-a2603a72-503b-4386-952c-b6a52a2c4248 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:04.214718 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-a2603a72-503b-4386-952c-b6a52a2c4248 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:04.218635 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-a2603a72-503b-4386-952c-b6a52a2c4248 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:04.225521 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-a2603a72-503b-4386-952c-b6a52a2c4248 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1808 microversion: 2.20 time: 0.297031 Jul 12 14:43:04.226775 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 224/439] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:43:03 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1808 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:43:04.263683 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-1d7b30d3-c2ee-4a65-ac88-1b79aa917f1c tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:04.271941 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-1d7b30d3-c2ee-4a65-ac88-1b79aa917f1c tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1749 microversion: 2.1 time: 0.290135 Jul 12 14:43:04.272646 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 216/440] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:03 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1749 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:05.246975 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-341ad145-8ca4-484b-82b6-be94f14e3e1f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:05.248089 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-341ad145-8ca4-484b-82b6-be94f14e3e1f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:05.254498 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-341ad145-8ca4-484b-82b6-be94f14e3e1f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:05.254946 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-341ad145-8ca4-484b-82b6-be94f14e3e1f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:05.255712 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-341ad145-8ca4-484b-82b6-be94f14e3e1f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:05.256260 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-341ad145-8ca4-484b-82b6-be94f14e3e1f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:05.297189 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-4fcaec76-7401-400f-9cae-4f19e94ced9c tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:05.297875 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-4fcaec76-7401-400f-9cae-4f19e94ced9c tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:05.305056 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4fcaec76-7401-400f-9cae-4f19e94ced9c tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:05.305672 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4fcaec76-7401-400f-9cae-4f19e94ced9c tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:05.306449 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4fcaec76-7401-400f-9cae-4f19e94ced9c tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:05.307045 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4fcaec76-7401-400f-9cae-4f19e94ced9c tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:05.511323 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-341ad145-8ca4-484b-82b6-be94f14e3e1f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:05.524861 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-341ad145-8ca4-484b-82b6-be94f14e3e1f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:05.526873 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-341ad145-8ca4-484b-82b6-be94f14e3e1f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:05.530596 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-341ad145-8ca4-484b-82b6-be94f14e3e1f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1808 microversion: 2.20 time: 0.286976 Jul 12 14:43:05.531714 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 225/441] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:43:05 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1808 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:43:05.543634 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-4fcaec76-7401-400f-9cae-4f19e94ced9c tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:05.551626 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-4fcaec76-7401-400f-9cae-4f19e94ced9c tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1749 microversion: 2.1 time: 0.265807 Jul 12 14:43:05.552191 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 217/442] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:05 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1749 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:06.550140 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-7a8a5921-30c9-4357-a9a8-e8415931b05c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:06.550784 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-7a8a5921-30c9-4357-a9a8-e8415931b05c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:06.563255 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7a8a5921-30c9-4357-a9a8-e8415931b05c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:06.563853 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7a8a5921-30c9-4357-a9a8-e8415931b05c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:06.564646 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7a8a5921-30c9-4357-a9a8-e8415931b05c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:06.565195 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7a8a5921-30c9-4357-a9a8-e8415931b05c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:06.570557 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-873fce21-6788-4333-b87d-5fd70e65b678 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:06.578780 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-873fce21-6788-4333-b87d-5fd70e65b678 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:06.578780 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-873fce21-6788-4333-b87d-5fd70e65b678 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:06.578780 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-873fce21-6788-4333-b87d-5fd70e65b678 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:06.578780 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-873fce21-6788-4333-b87d-5fd70e65b678 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:06.579198 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-873fce21-6788-4333-b87d-5fd70e65b678 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:06.808893 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-873fce21-6788-4333-b87d-5fd70e65b678 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:06.811838 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7a8a5921-30c9-4357-a9a8-e8415931b05c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:06.816992 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-873fce21-6788-4333-b87d-5fd70e65b678 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1749 microversion: 2.1 time: 0.250371 Jul 12 14:43:06.817597 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 218/443] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:06 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1749 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:06.820417 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7a8a5921-30c9-4357-a9a8-e8415931b05c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:06.821964 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7a8a5921-30c9-4357-a9a8-e8415931b05c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:06.823123 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-7a8a5921-30c9-4357-a9a8-e8415931b05c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1808 microversion: 2.20 time: 0.277647 Jul 12 14:43:06.823677 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 226/444] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:43:06 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1808 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:43:07.840562 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-38d69440-a229-422a-a56e-a177499e8be5 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:07.840562 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-38d69440-a229-422a-a56e-a177499e8be5 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:07.842596 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-f8fe138d-a7a3-43c5-80b5-e77327f06dad tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:07.843203 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-f8fe138d-a7a3-43c5-80b5-e77327f06dad tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:07.843750 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-38d69440-a229-422a-a56e-a177499e8be5 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:07.844583 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-38d69440-a229-422a-a56e-a177499e8be5 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:07.846017 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-38d69440-a229-422a-a56e-a177499e8be5 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:07.846643 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-38d69440-a229-422a-a56e-a177499e8be5 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:07.850183 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f8fe138d-a7a3-43c5-80b5-e77327f06dad tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:07.850632 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f8fe138d-a7a3-43c5-80b5-e77327f06dad tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:07.851397 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f8fe138d-a7a3-43c5-80b5-e77327f06dad tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:07.851823 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f8fe138d-a7a3-43c5-80b5-e77327f06dad tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:08.148565 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-38d69440-a229-422a-a56e-a177499e8be5 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:08.156980 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-f8fe138d-a7a3-43c5-80b5-e77327f06dad tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:08.159310 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-38d69440-a229-422a-a56e-a177499e8be5 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1749 microversion: 2.1 time: 0.328596 Jul 12 14:43:08.160340 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 219/445] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:07 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1749 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:08.171528 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-f8fe138d-a7a3-43c5-80b5-e77327f06dad tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:08.173040 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-f8fe138d-a7a3-43c5-80b5-e77327f06dad tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:08.174282 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-f8fe138d-a7a3-43c5-80b5-e77327f06dad tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1808 microversion: 2.20 time: 0.336472 Jul 12 14:43:08.175168 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 227/446] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:43:07 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1808 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:43:09.177911 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-3afa6e64-2e61-4e87-8f92-ac5de5b36ec9 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:09.179209 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-3afa6e64-2e61-4e87-8f92-ac5de5b36ec9 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:09.191346 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3afa6e64-2e61-4e87-8f92-ac5de5b36ec9 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:09.191346 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3afa6e64-2e61-4e87-8f92-ac5de5b36ec9 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:09.191346 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3afa6e64-2e61-4e87-8f92-ac5de5b36ec9 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:09.191346 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3afa6e64-2e61-4e87-8f92-ac5de5b36ec9 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:09.193744 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-876e32f5-7b09-42b6-879b-f6e08352eb2a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:09.194442 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-876e32f5-7b09-42b6-879b-f6e08352eb2a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:09.202336 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-876e32f5-7b09-42b6-879b-f6e08352eb2a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:09.203044 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-876e32f5-7b09-42b6-879b-f6e08352eb2a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:09.204084 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-876e32f5-7b09-42b6-879b-f6e08352eb2a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:09.204684 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-876e32f5-7b09-42b6-879b-f6e08352eb2a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:09.452819 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-876e32f5-7b09-42b6-879b-f6e08352eb2a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:09.463841 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-876e32f5-7b09-42b6-879b-f6e08352eb2a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:09.465371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-876e32f5-7b09-42b6-879b-f6e08352eb2a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:09.466570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-876e32f5-7b09-42b6-879b-f6e08352eb2a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1808 microversion: 2.20 time: 0.276881 Jul 12 14:43:09.467129 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 228/447] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:43:09 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1808 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:43:09.471579 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-3afa6e64-2e61-4e87-8f92-ac5de5b36ec9 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:09.480473 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-3afa6e64-2e61-4e87-8f92-ac5de5b36ec9 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1749 microversion: 2.1 time: 0.307463 Jul 12 14:43:09.481044 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 220/448] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:09 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1749 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:10.485514 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-0c01be71-4325-4e7d-bcd9-f94447fb1deb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:10.486765 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-0c01be71-4325-4e7d-bcd9-f94447fb1deb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:10.493886 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0c01be71-4325-4e7d-bcd9-f94447fb1deb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:10.494558 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0c01be71-4325-4e7d-bcd9-f94447fb1deb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:10.495896 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0c01be71-4325-4e7d-bcd9-f94447fb1deb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:10.496337 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0c01be71-4325-4e7d-bcd9-f94447fb1deb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:10.499588 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-106b990b-f8e9-43a3-9628-2a161a77939d tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:10.500212 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-106b990b-f8e9-43a3-9628-2a161a77939d tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:10.506990 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-106b990b-f8e9-43a3-9628-2a161a77939d tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:10.507514 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-106b990b-f8e9-43a3-9628-2a161a77939d tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:10.508279 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-106b990b-f8e9-43a3-9628-2a161a77939d tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:10.508710 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-106b990b-f8e9-43a3-9628-2a161a77939d tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:10.808880 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-0c01be71-4325-4e7d-bcd9-f94447fb1deb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:10.818292 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-0c01be71-4325-4e7d-bcd9-f94447fb1deb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:10.819857 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-0c01be71-4325-4e7d-bcd9-f94447fb1deb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:10.821264 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-0c01be71-4325-4e7d-bcd9-f94447fb1deb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1808 microversion: 2.20 time: 0.340423 Jul 12 14:43:10.822096 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 229/449] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:43:10 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1808 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:43:10.875222 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-106b990b-f8e9-43a3-9628-2a161a77939d tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:10.883460 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-106b990b-f8e9-43a3-9628-2a161a77939d tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1749 microversion: 2.1 time: 0.389703 Jul 12 14:43:10.884038 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 221/450] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:10 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1749 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:11.839703 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-1027c49f-fb67-4bce-8c1a-9eafca91c56b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:11.840353 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-1027c49f-fb67-4bce-8c1a-9eafca91c56b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:11.847802 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1027c49f-fb67-4bce-8c1a-9eafca91c56b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:11.847922 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1027c49f-fb67-4bce-8c1a-9eafca91c56b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:11.848592 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1027c49f-fb67-4bce-8c1a-9eafca91c56b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:11.849244 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1027c49f-fb67-4bce-8c1a-9eafca91c56b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:11.906123 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-04fc7c5e-a55d-4508-bdea-f26d2ee22caa tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:11.906954 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-04fc7c5e-a55d-4508-bdea-f26d2ee22caa tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:11.915789 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-04fc7c5e-a55d-4508-bdea-f26d2ee22caa tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:11.916246 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-04fc7c5e-a55d-4508-bdea-f26d2ee22caa tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:11.917729 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-04fc7c5e-a55d-4508-bdea-f26d2ee22caa tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:11.918287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-04fc7c5e-a55d-4508-bdea-f26d2ee22caa tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:12.026711 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-1027c49f-fb67-4bce-8c1a-9eafca91c56b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:12.035754 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-1027c49f-fb67-4bce-8c1a-9eafca91c56b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:12.037285 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-1027c49f-fb67-4bce-8c1a-9eafca91c56b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:12.042146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-1027c49f-fb67-4bce-8c1a-9eafca91c56b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1808 microversion: 2.20 time: 0.202708 Jul 12 14:43:12.042146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 230/451] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:43:11 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:43:12.103134 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-04fc7c5e-a55d-4508-bdea-f26d2ee22caa tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:12.111263 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-04fc7c5e-a55d-4508-bdea-f26d2ee22caa tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1754 microversion: 2.1 time: 0.209531 Jul 12 14:43:12.111923 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 222/452] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:11 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1754 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:13.056787 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-4167f27f-1548-4c55-bec1-2105ffc9efd6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:13.057735 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-4167f27f-1548-4c55-bec1-2105ffc9efd6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:13.066529 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4167f27f-1548-4c55-bec1-2105ffc9efd6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:13.067074 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4167f27f-1548-4c55-bec1-2105ffc9efd6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:13.068061 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4167f27f-1548-4c55-bec1-2105ffc9efd6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:13.068594 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4167f27f-1548-4c55-bec1-2105ffc9efd6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:13.129583 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-c84914e2-e943-4fcb-98be-d993c9c821dc tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:13.130139 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-c84914e2-e943-4fcb-98be-d993c9c821dc tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:13.136939 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c84914e2-e943-4fcb-98be-d993c9c821dc tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:13.137498 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c84914e2-e943-4fcb-98be-d993c9c821dc tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:13.138837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c84914e2-e943-4fcb-98be-d993c9c821dc tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:13.139274 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c84914e2-e943-4fcb-98be-d993c9c821dc tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:13.421268 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-4167f27f-1548-4c55-bec1-2105ffc9efd6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:13.430957 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-4167f27f-1548-4c55-bec1-2105ffc9efd6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:13.434181 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-4167f27f-1548-4c55-bec1-2105ffc9efd6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:13.435892 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-4167f27f-1548-4c55-bec1-2105ffc9efd6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1808 microversion: 2.20 time: 0.383338 Jul 12 14:43:13.436462 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 231/453] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:43:13 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1808 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:43:13.549452 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-c84914e2-e943-4fcb-98be-d993c9c821dc tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:13.560596 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-c84914e2-e943-4fcb-98be-d993c9c821dc tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1754 microversion: 2.1 time: 0.434319 Jul 12 14:43:13.562074 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 223/454] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:13 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1754 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:14.455290 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-98d87127-f607-49d5-a554-b052df17075f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:14.456495 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-98d87127-f607-49d5-a554-b052df17075f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:14.463246 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-98d87127-f607-49d5-a554-b052df17075f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:14.464554 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-98d87127-f607-49d5-a554-b052df17075f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:14.464554 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-98d87127-f607-49d5-a554-b052df17075f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:14.464906 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-98d87127-f607-49d5-a554-b052df17075f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:14.579786 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-7a555d4a-6046-406e-8c51-7c99a098d964 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:14.580512 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-7a555d4a-6046-406e-8c51-7c99a098d964 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:14.590841 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7a555d4a-6046-406e-8c51-7c99a098d964 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:14.594110 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7a555d4a-6046-406e-8c51-7c99a098d964 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:14.595112 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7a555d4a-6046-406e-8c51-7c99a098d964 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:14.595831 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7a555d4a-6046-406e-8c51-7c99a098d964 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:14.657486 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-98d87127-f607-49d5-a554-b052df17075f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:14.666732 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-98d87127-f607-49d5-a554-b052df17075f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:14.673990 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-98d87127-f607-49d5-a554-b052df17075f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:14.675543 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-98d87127-f607-49d5-a554-b052df17075f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1808 microversion: 2.20 time: 0.225383 Jul 12 14:43:14.676636 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 232/455] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:43:14 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:43:14.808212 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-7a555d4a-6046-406e-8c51-7c99a098d964 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:14.817459 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-7a555d4a-6046-406e-8c51-7c99a098d964 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1754 microversion: 2.1 time: 0.242561 Jul 12 14:43:14.818237 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 224/456] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:14 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1754 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:15.694819 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-89a9b72a-3d36-4fb2-9f81-a1792c8c6fea tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:15.695460 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-89a9b72a-3d36-4fb2-9f81-a1792c8c6fea tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:15.703210 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-89a9b72a-3d36-4fb2-9f81-a1792c8c6fea tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:15.703652 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-89a9b72a-3d36-4fb2-9f81-a1792c8c6fea tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:15.704414 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-89a9b72a-3d36-4fb2-9f81-a1792c8c6fea tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:15.704846 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-89a9b72a-3d36-4fb2-9f81-a1792c8c6fea tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:15.835819 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ab7d521a-e7a4-4737-931b-1d5417468ac4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:15.836430 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-ab7d521a-e7a4-4737-931b-1d5417468ac4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:15.842851 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-89a9b72a-3d36-4fb2-9f81-a1792c8c6fea tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:15.844734 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ab7d521a-e7a4-4737-931b-1d5417468ac4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:15.845427 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ab7d521a-e7a4-4737-931b-1d5417468ac4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:15.846211 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ab7d521a-e7a4-4737-931b-1d5417468ac4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:15.846643 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ab7d521a-e7a4-4737-931b-1d5417468ac4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:15.851500 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-89a9b72a-3d36-4fb2-9f81-a1792c8c6fea tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:15.853930 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-89a9b72a-3d36-4fb2-9f81-a1792c8c6fea tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:15.855089 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-89a9b72a-3d36-4fb2-9f81-a1792c8c6fea tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1808 microversion: 2.20 time: 0.164382 Jul 12 14:43:15.855645 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 233/457] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:43:15 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:43:15.869516 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:16.022554 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ab7d521a-e7a4-4737-931b-1d5417468ac4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:16.032133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ab7d521a-e7a4-4737-931b-1d5417468ac4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1754 microversion: 2.1 time: 0.199983 Jul 12 14:43:16.032775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 225/458] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:15 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1754 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:16.524460 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-024f2457-9c04-4b2c-8f09-09a3e72ce5c5 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1412463356", "imageRef": "a66ccacb-7b1e-4f51-9eaf-069a356e0fdb", "flavorRef": "452", "networks": [{"uuid": "1d62481f-a360-40af-871f-8e152ec500d6"}]}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:43:16.588813 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.network.neutron [None req-024f2457-9c04-4b2c-8f09-09a3e72ce5c5 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] validate_networks() for [('1d62481f-a360-40af-871f-8e152ec500d6', None, None, None, None, None)] {{(pid=129981) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:43:16.873938 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-88ba8ddb-f2f9-414a-a617-236a3c5af1b1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:16.875341 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-88ba8ddb-f2f9-414a-a617-236a3c5af1b1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:16.882238 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-88ba8ddb-f2f9-414a-a617-236a3c5af1b1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:16.883037 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-88ba8ddb-f2f9-414a-a617-236a3c5af1b1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:16.884030 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-88ba8ddb-f2f9-414a-a617-236a3c5af1b1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:16.884680 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-88ba8ddb-f2f9-414a-a617-236a3c5af1b1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:17.054186 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-024f2457-9c04-4b2c-8f09-09a3e72ce5c5 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Flavor limits 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:43:17.056149 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-024f2457-9c04-4b2c-8f09-09a3e72ce5c5 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Image limits 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:43:17.057124 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-024f2457-9c04-4b2c-8f09-09a3e72ce5c5 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Flavor pref 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:43:17.058513 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-024f2457-9c04-4b2c-8f09-09a3e72ce5c5 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Image pref 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:43:17.059034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-024f2457-9c04-4b2c-8f09-09a3e72ce5c5 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:43:17.083982 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-88ba8ddb-f2f9-414a-a617-236a3c5af1b1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:17.093226 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-024f2457-9c04-4b2c-8f09-09a3e72ce5c5 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:17.093703 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-88ba8ddb-f2f9-414a-a617-236a3c5af1b1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:17.094021 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-024f2457-9c04-4b2c-8f09-09a3e72ce5c5 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:17.095451 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-024f2457-9c04-4b2c-8f09-09a3e72ce5c5 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:17.095920 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-024f2457-9c04-4b2c-8f09-09a3e72ce5c5 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:17.096246 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-88ba8ddb-f2f9-414a-a617-236a3c5af1b1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:17.097931 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-88ba8ddb-f2f9-414a-a617-236a3c5af1b1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1808 microversion: 2.20 time: 0.228730 Jul 12 14:43:17.110867 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 226/459] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:43:16 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1808 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:43:17.116590 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-b48a7938-02b8-4564-8d5e-777ec89d94d2 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:17.118324 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-b48a7938-02b8-4564-8d5e-777ec89d94d2 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:17.118600 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.quota [None req-024f2457-9c04-4b2c-8f09-09a3e72ce5c5 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Getting quotas for project 1f15caa06dac4f2b952ff64f9e9e74ca. Resources: {'instances', 'cores', 'ram'} {{(pid=129981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:43:17.127369 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.quota [None req-024f2457-9c04-4b2c-8f09-09a3e72ce5c5 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Getting quotas for user 9ac06a23a9b84ec38e0712bad9046762 and project 1f15caa06dac4f2b952ff64f9e9e74ca. Resources: {'instances', 'cores', 'ram'} {{(pid=129981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:43:17.131302 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b48a7938-02b8-4564-8d5e-777ec89d94d2 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:17.131772 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b48a7938-02b8-4564-8d5e-777ec89d94d2 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:17.133517 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b48a7938-02b8-4564-8d5e-777ec89d94d2 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:17.133965 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b48a7938-02b8-4564-8d5e-777ec89d94d2 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:17.145116 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-024f2457-9c04-4b2c-8f09-09a3e72ce5c5 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Going to run 1 instances... {{(pid=129981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:43:17.147709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-024f2457-9c04-4b2c-8f09-09a3e72ce5c5 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: d89391af-dbb1-4992-8b67-5e0dee22c2be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a66ccacb-7b1e-4f51-9eaf-069a356e0fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:43:17.270552 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-024f2457-9c04-4b2c-8f09-09a3e72ce5c5 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.749853 Jul 12 14:43:17.271857 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 234/460] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Jul 12 14:43:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:43:17.282424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-ab602a32-2a19-44aa-b5ef-fc511df49c02 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:17.283335 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-ab602a32-2a19-44aa-b5ef-fc511df49c02 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: d89391af-dbb1-4992-8b67-5e0dee22c2be] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:17.364040 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-ab602a32-2a19-44aa-b5ef-fc511df49c02 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:17.372151 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-ab602a32-2a19-44aa-b5ef-fc511df49c02 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be" status: 200 len: 1214 microversion: 2.1 time: 0.094498 Jul 12 14:43:17.372750 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 235/461] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:17 2022] GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:17.395130 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-b48a7938-02b8-4564-8d5e-777ec89d94d2 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:17.404538 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-b48a7938-02b8-4564-8d5e-777ec89d94d2 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1754 microversion: 2.1 time: 0.291831 Jul 12 14:43:17.405798 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 227/462] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:17 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1754 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:18.119845 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c9be7975-0c76-4092-93bf-0d334891deb9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:18.120845 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-c9be7975-0c76-4092-93bf-0d334891deb9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:18.128029 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c9be7975-0c76-4092-93bf-0d334891deb9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:18.128475 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c9be7975-0c76-4092-93bf-0d334891deb9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:18.129265 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c9be7975-0c76-4092-93bf-0d334891deb9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:18.129699 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c9be7975-0c76-4092-93bf-0d334891deb9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:18.273581 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c9be7975-0c76-4092-93bf-0d334891deb9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:18.282858 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c9be7975-0c76-4092-93bf-0d334891deb9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:18.284615 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c9be7975-0c76-4092-93bf-0d334891deb9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:18.285911 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-c9be7975-0c76-4092-93bf-0d334891deb9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1808 microversion: 2.20 time: 0.169992 Jul 12 14:43:18.286587 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 236/463] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:43:18 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:43:18.388886 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-3d7234dc-3e72-4a4f-ae3e-09c57cf0907d tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:18.395239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-3d7234dc-3e72-4a4f-ae3e-09c57cf0907d tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: d89391af-dbb1-4992-8b67-5e0dee22c2be] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:18.423379 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d96e42c0-c312-47f2-b7cd-46d9a832640d tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:18.435130 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-d96e42c0-c312-47f2-b7cd-46d9a832640d tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:18.452712 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d96e42c0-c312-47f2-b7cd-46d9a832640d tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:18.453545 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d96e42c0-c312-47f2-b7cd-46d9a832640d tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:18.457826 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d96e42c0-c312-47f2-b7cd-46d9a832640d tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:18.458549 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d96e42c0-c312-47f2-b7cd-46d9a832640d tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:18.487397 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-3d7234dc-3e72-4a4f-ae3e-09c57cf0907d tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:18.497310 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-3d7234dc-3e72-4a4f-ae3e-09c57cf0907d tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be" status: 200 len: 1214 microversion: 2.1 time: 0.112186 Jul 12 14:43:18.500357 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 228/464] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:18 2022] GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:18.712146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d96e42c0-c312-47f2-b7cd-46d9a832640d tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:18.718515 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-d96e42c0-c312-47f2-b7cd-46d9a832640d tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1754 microversion: 2.1 time: 0.299499 Jul 12 14:43:18.719784 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 237/465] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:18 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1754 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:19.304659 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-54df5597-5c1c-451c-aac4-117db6e9eea9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:19.305285 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-54df5597-5c1c-451c-aac4-117db6e9eea9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:19.315471 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-54df5597-5c1c-451c-aac4-117db6e9eea9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:19.315926 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-54df5597-5c1c-451c-aac4-117db6e9eea9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:19.316703 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-54df5597-5c1c-451c-aac4-117db6e9eea9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:19.317140 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-54df5597-5c1c-451c-aac4-117db6e9eea9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:19.463613 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-54df5597-5c1c-451c-aac4-117db6e9eea9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:19.479337 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-54df5597-5c1c-451c-aac4-117db6e9eea9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:19.480892 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-54df5597-5c1c-451c-aac4-117db6e9eea9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:19.482781 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-54df5597-5c1c-451c-aac4-117db6e9eea9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1808 microversion: 2.20 time: 0.181968 Jul 12 14:43:19.483767 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 229/466] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:43:19 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:43:19.515045 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-fea96682-4fe7-411d-98f8-eaee6bcbf59f tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:19.516306 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-fea96682-4fe7-411d-98f8-eaee6bcbf59f tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: d89391af-dbb1-4992-8b67-5e0dee22c2be] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:19.524015 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fea96682-4fe7-411d-98f8-eaee6bcbf59f tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:19.524931 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fea96682-4fe7-411d-98f8-eaee6bcbf59f tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:19.525977 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fea96682-4fe7-411d-98f8-eaee6bcbf59f tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:19.526637 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fea96682-4fe7-411d-98f8-eaee6bcbf59f tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:19.527501 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-4908130e-0b83-4d8e-8214-c2359c336c0e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68b1884c-54d0-412f-8946-a28baead197e"}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:43:19.530102 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-4908130e-0b83-4d8e-8214-c2359c336c0e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:19.538544 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4908130e-0b83-4d8e-8214-c2359c336c0e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:19.539562 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4908130e-0b83-4d8e-8214-c2359c336c0e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:19.541445 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4908130e-0b83-4d8e-8214-c2359c336c0e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:19.542282 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4908130e-0b83-4d8e-8214-c2359c336c0e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:19.607371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-fea96682-4fe7-411d-98f8-eaee6bcbf59f tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:19.616101 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-fea96682-4fe7-411d-98f8-eaee6bcbf59f tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be" status: 200 len: 1266 microversion: 2.1 time: 0.105523 Jul 12 14:43:19.617734 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 238/467] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:19 2022] GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:19.736576 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-f828582a-626e-43a3-b141-244abcc33fed tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:19.737224 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-f828582a-626e-43a3-b141-244abcc33fed tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:19.743709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f828582a-626e-43a3-b141-244abcc33fed tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:19.744162 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f828582a-626e-43a3-b141-244abcc33fed tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:19.745187 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f828582a-626e-43a3-b141-244abcc33fed tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:19.746167 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f828582a-626e-43a3-b141-244abcc33fed tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:20.033315 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-f828582a-626e-43a3-b141-244abcc33fed tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:20.043498 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-f828582a-626e-43a3-b141-244abcc33fed tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1754 microversion: 2.1 time: 0.311310 Jul 12 14:43:20.044100 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 239/468] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:19 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1754 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:20.497087 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-4908130e-0b83-4d8e-8214-c2359c336c0e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "POST /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.975394 Jul 12 14:43:20.503989 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 230/469] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Jul 12 14:43:19 2022] POST /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb/os-volume_attachments => generated 194 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:43:20.504146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-943502ae-b28c-4c12-b930-2bc8a4644901 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:20.505812 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-943502ae-b28c-4c12-b930-2bc8a4644901 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:20.514215 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-943502ae-b28c-4c12-b930-2bc8a4644901 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:20.515025 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-943502ae-b28c-4c12-b930-2bc8a4644901 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:20.516101 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-943502ae-b28c-4c12-b930-2bc8a4644901 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:20.517192 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-943502ae-b28c-4c12-b930-2bc8a4644901 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:20.635978 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-2d27be9c-3b55-46f3-9896-39e2b7ffe1c4 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:20.636257 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-2d27be9c-3b55-46f3-9896-39e2b7ffe1c4 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: d89391af-dbb1-4992-8b67-5e0dee22c2be] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:20.648377 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2d27be9c-3b55-46f3-9896-39e2b7ffe1c4 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:20.648831 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2d27be9c-3b55-46f3-9896-39e2b7ffe1c4 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:20.649645 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2d27be9c-3b55-46f3-9896-39e2b7ffe1c4 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:20.650079 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2d27be9c-3b55-46f3-9896-39e2b7ffe1c4 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:20.845694 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-2d27be9c-3b55-46f3-9896-39e2b7ffe1c4 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:20.861232 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-2d27be9c-3b55-46f3-9896-39e2b7ffe1c4 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be" status: 200 len: 1272 microversion: 2.1 time: 0.229135 Jul 12 14:43:20.874846 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 231/470] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:20 2022] GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be => generated 1272 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:20.912775 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-943502ae-b28c-4c12-b930-2bc8a4644901 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:20.919169 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=100 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:20.925973 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-943502ae-b28c-4c12-b930-2bc8a4644901 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:20.927544 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-943502ae-b28c-4c12-b930-2bc8a4644901 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:20.928747 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-943502ae-b28c-4c12-b930-2bc8a4644901 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1808 microversion: 2.20 time: 0.431342 Jul 12 14:43:20.929357 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 240/471] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:43:20 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1808 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:43:20.945979 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-d3b76950-caf7-4a8e-bcc7-611fd96c81c6 req-03e8902c-51ab-4137-b555-865caa60a7ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26eeea2d-c1c2-46a7-b727-269cf6dce92a", "name": "network-vif-plugged", "status": "completed", "tag": "f0edff70-5e51-412d-b474-2a70b09725f5"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:43:20.958615 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-d3b76950-caf7-4a8e-bcc7-611fd96c81c6 req-03e8902c-51ab-4137-b555-865caa60a7ae service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:20.959781 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-d3b76950-caf7-4a8e-bcc7-611fd96c81c6 req-03e8902c-51ab-4137-b555-865caa60a7ae service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:20.973256 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-d3b76950-caf7-4a8e-bcc7-611fd96c81c6 req-03e8902c-51ab-4137-b555-865caa60a7ae service nova] Creating event network-vif-plugged:f0edff70-5e51-412d-b474-2a70b09725f5 for instance 26eeea2d-c1c2-46a7-b727-269cf6dce92a on hv-cinder-82002 Jul 12 14:43:20.978867 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-d3b76950-caf7-4a8e-bcc7-611fd96c81c6 req-03e8902c-51ab-4137-b555-865caa60a7ae service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036991 Jul 12 14:43:20.980094 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 232/472] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:43:21.062666 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-8ae6e6dd-835a-496b-aebe-c231a230188e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:21.063871 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-8ae6e6dd-835a-496b-aebe-c231a230188e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:21.075558 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8ae6e6dd-835a-496b-aebe-c231a230188e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:21.076252 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8ae6e6dd-835a-496b-aebe-c231a230188e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:21.078351 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8ae6e6dd-835a-496b-aebe-c231a230188e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:21.078351 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8ae6e6dd-835a-496b-aebe-c231a230188e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:21.329652 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-8ae6e6dd-835a-496b-aebe-c231a230188e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:21.339121 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-8ae6e6dd-835a-496b-aebe-c231a230188e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1754 microversion: 2.1 time: 0.281261 Jul 12 14:43:21.343958 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 241/473] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:21 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1754 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:21.886210 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-da2d6e73-4e73-4688-8415-740df47a5766 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:21.887607 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-da2d6e73-4e73-4688-8415-740df47a5766 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: d89391af-dbb1-4992-8b67-5e0dee22c2be] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:21.899831 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-da2d6e73-4e73-4688-8415-740df47a5766 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:21.900288 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-da2d6e73-4e73-4688-8415-740df47a5766 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:21.901072 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-da2d6e73-4e73-4688-8415-740df47a5766 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:21.903905 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-da2d6e73-4e73-4688-8415-740df47a5766 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:21.951821 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-b214fc44-b312-46fe-bce0-4f03c8146f0f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:21.952672 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-b214fc44-b312-46fe-bce0-4f03c8146f0f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:21.979239 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b214fc44-b312-46fe-bce0-4f03c8146f0f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:21.981670 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b214fc44-b312-46fe-bce0-4f03c8146f0f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:21.984219 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b214fc44-b312-46fe-bce0-4f03c8146f0f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:21.986317 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b214fc44-b312-46fe-bce0-4f03c8146f0f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:22.335290 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-da2d6e73-4e73-4688-8415-740df47a5766 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:22.345445 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-da2d6e73-4e73-4688-8415-740df47a5766 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be" status: 200 len: 1314 microversion: 2.1 time: 0.468891 Jul 12 14:43:22.354921 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 233/474] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:21 2022] GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:22.360601 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ea515f6b-9c2d-45ac-8f42-e021903f395f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:22.361899 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-ea515f6b-9c2d-45ac-8f42-e021903f395f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:22.371688 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ea515f6b-9c2d-45ac-8f42-e021903f395f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:22.373061 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ea515f6b-9c2d-45ac-8f42-e021903f395f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:22.374074 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ea515f6b-9c2d-45ac-8f42-e021903f395f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:22.375127 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ea515f6b-9c2d-45ac-8f42-e021903f395f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:22.463085 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-b214fc44-b312-46fe-bce0-4f03c8146f0f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:22.473971 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-b214fc44-b312-46fe-bce0-4f03c8146f0f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:22.475550 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-b214fc44-b312-46fe-bce0-4f03c8146f0f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:22.477915 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-b214fc44-b312-46fe-bce0-4f03c8146f0f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1808 microversion: 2.20 time: 0.533388 Jul 12 14:43:22.479024 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 242/475] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:43:21 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1808 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:43:22.721433 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ea515f6b-9c2d-45ac-8f42-e021903f395f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:22.735526 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ea515f6b-9c2d-45ac-8f42-e021903f395f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1754 microversion: 2.1 time: 0.379271 Jul 12 14:43:22.736370 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 234/476] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:22 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1754 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:22.942324 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-d79c149e-b9a0-48c0-b8e1-2d8f4098cd32 req-01b4a718-1b9f-4b05-8ddc-3cee3a888330 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d89391af-dbb1-4992-8b67-5e0dee22c2be", "tag": "6678e823-f3e8-4d61-b5db-3f7cd99a101b"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:43:22.957279 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-d79c149e-b9a0-48c0-b8e1-2d8f4098cd32 req-01b4a718-1b9f-4b05-8ddc-3cee3a888330 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:22.957952 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-d79c149e-b9a0-48c0-b8e1-2d8f4098cd32 req-01b4a718-1b9f-4b05-8ddc-3cee3a888330 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:22.978004 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-d79c149e-b9a0-48c0-b8e1-2d8f4098cd32 req-01b4a718-1b9f-4b05-8ddc-3cee3a888330 service nova] Creating event network-changed:6678e823-f3e8-4d61-b5db-3f7cd99a101b for instance d89391af-dbb1-4992-8b67-5e0dee22c2be on hv-cinder-82002 Jul 12 14:43:22.986255 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-d79c149e-b9a0-48c0-b8e1-2d8f4098cd32 req-01b4a718-1b9f-4b05-8ddc-3cee3a888330 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047829 Jul 12 14:43:22.987309 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 243/477] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:43:23.364234 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-3d782508-c4e0-4b90-9a80-5eac5f219e53 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:23.364853 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-3d782508-c4e0-4b90-9a80-5eac5f219e53 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: d89391af-dbb1-4992-8b67-5e0dee22c2be] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:23.371731 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3d782508-c4e0-4b90-9a80-5eac5f219e53 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:23.372181 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3d782508-c4e0-4b90-9a80-5eac5f219e53 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:23.373541 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3d782508-c4e0-4b90-9a80-5eac5f219e53 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:23.374186 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3d782508-c4e0-4b90-9a80-5eac5f219e53 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:23.515912 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-34b92df5-b081-40e2-b495-7b4e63f2ea0e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:23.516865 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-34b92df5-b081-40e2-b495-7b4e63f2ea0e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:23.530065 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-34b92df5-b081-40e2-b495-7b4e63f2ea0e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:23.530888 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-34b92df5-b081-40e2-b495-7b4e63f2ea0e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:23.532097 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-34b92df5-b081-40e2-b495-7b4e63f2ea0e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:23.532758 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-34b92df5-b081-40e2-b495-7b4e63f2ea0e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:23.739677 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-3d782508-c4e0-4b90-9a80-5eac5f219e53 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:23.755484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-3d782508-c4e0-4b90-9a80-5eac5f219e53 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be" status: 200 len: 1314 microversion: 2.1 time: 0.395190 Jul 12 14:43:23.758835 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 235/478] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:23 2022] GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:23.766865 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-f33679b4-104c-4b8d-a42c-a9924841e25e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:23.767987 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-f33679b4-104c-4b8d-a42c-a9924841e25e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:23.774980 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-34b92df5-b081-40e2-b495-7b4e63f2ea0e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:23.776565 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f33679b4-104c-4b8d-a42c-a9924841e25e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:23.777394 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f33679b4-104c-4b8d-a42c-a9924841e25e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:23.779452 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f33679b4-104c-4b8d-a42c-a9924841e25e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:23.780207 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f33679b4-104c-4b8d-a42c-a9924841e25e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:23.785817 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-34b92df5-b081-40e2-b495-7b4e63f2ea0e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:23.787360 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-34b92df5-b081-40e2-b495-7b4e63f2ea0e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:23.796958 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-34b92df5-b081-40e2-b495-7b4e63f2ea0e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1808 microversion: 2.20 time: 0.301673 Jul 12 14:43:23.799365 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 244/479] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:43:23 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1808 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:43:23.961185 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-f33679b4-104c-4b8d-a42c-a9924841e25e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:23.970352 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-f33679b4-104c-4b8d-a42c-a9924841e25e tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1754 microversion: 2.1 time: 0.210001 Jul 12 14:43:23.971019 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 236/480] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:23 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1754 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:24.777085 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-b83575c2-b6cb-42b0-951b-c5bc78774c11 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:24.777778 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-b83575c2-b6cb-42b0-951b-c5bc78774c11 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: d89391af-dbb1-4992-8b67-5e0dee22c2be] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:24.787207 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b83575c2-b6cb-42b0-951b-c5bc78774c11 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:24.787969 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b83575c2-b6cb-42b0-951b-c5bc78774c11 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:24.788948 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b83575c2-b6cb-42b0-951b-c5bc78774c11 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:24.789564 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b83575c2-b6cb-42b0-951b-c5bc78774c11 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:24.816466 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-46c964d9-eb42-43a4-b78f-3bbd61636433 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:24.817070 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-46c964d9-eb42-43a4-b78f-3bbd61636433 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:24.828450 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-46c964d9-eb42-43a4-b78f-3bbd61636433 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:24.829245 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-46c964d9-eb42-43a4-b78f-3bbd61636433 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:24.830203 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-46c964d9-eb42-43a4-b78f-3bbd61636433 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:24.830872 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-46c964d9-eb42-43a4-b78f-3bbd61636433 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:25.167888 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-46c964d9-eb42-43a4-b78f-3bbd61636433 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:25.181811 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-46c964d9-eb42-43a4-b78f-3bbd61636433 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:25.181811 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-46c964d9-eb42-43a4-b78f-3bbd61636433 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:25.181811 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-46c964d9-eb42-43a4-b78f-3bbd61636433 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1808 microversion: 2.20 time: 0.369081 Jul 12 14:43:25.189330 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 237/481] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:43:24 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1808 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:43:25.205033 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-47a715e3-a60a-4c2b-a35a-7bc9f35c1187 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:25.205135 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-b83575c2-b6cb-42b0-951b-c5bc78774c11 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:25.205304 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-47a715e3-a60a-4c2b-a35a-7bc9f35c1187 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:25.212605 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-b83575c2-b6cb-42b0-951b-c5bc78774c11 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be" status: 200 len: 1314 microversion: 2.1 time: 0.441564 Jul 12 14:43:25.213127 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 245/482] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:24 2022] GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:25.227789 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-47a715e3-a60a-4c2b-a35a-7bc9f35c1187 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:25.229395 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-47a715e3-a60a-4c2b-a35a-7bc9f35c1187 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:25.233659 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-47a715e3-a60a-4c2b-a35a-7bc9f35c1187 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:25.233659 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-47a715e3-a60a-4c2b-a35a-7bc9f35c1187 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:25.429239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-47a715e3-a60a-4c2b-a35a-7bc9f35c1187 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:25.439941 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-47a715e3-a60a-4c2b-a35a-7bc9f35c1187 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1754 microversion: 2.1 time: 0.248096 Jul 12 14:43:25.440765 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 238/483] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:25 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1754 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:26.199743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d3921285-9a52-4c61-9659-4098bc58bd74 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:26.200325 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-d3921285-9a52-4c61-9659-4098bc58bd74 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:26.208746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d3921285-9a52-4c61-9659-4098bc58bd74 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:26.209393 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d3921285-9a52-4c61-9659-4098bc58bd74 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:26.210149 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d3921285-9a52-4c61-9659-4098bc58bd74 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:26.213438 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d3921285-9a52-4c61-9659-4098bc58bd74 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:26.231474 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-d2feae3d-6939-474a-8002-d13285907e31 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:26.233957 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-d2feae3d-6939-474a-8002-d13285907e31 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: d89391af-dbb1-4992-8b67-5e0dee22c2be] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:26.242592 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d2feae3d-6939-474a-8002-d13285907e31 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:26.243836 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d2feae3d-6939-474a-8002-d13285907e31 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:26.245017 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d2feae3d-6939-474a-8002-d13285907e31 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:26.246011 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d2feae3d-6939-474a-8002-d13285907e31 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:26.431553 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d3921285-9a52-4c61-9659-4098bc58bd74 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:26.440963 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d3921285-9a52-4c61-9659-4098bc58bd74 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:26.446861 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d3921285-9a52-4c61-9659-4098bc58bd74 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:26.448064 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-d3921285-9a52-4c61-9659-4098bc58bd74 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1795 microversion: 2.20 time: 0.252902 Jul 12 14:43:26.461638 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 246/484] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:43:26 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1795 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:43:26.466793 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-fd79c8c1-d1e8-406b-8acf-09ce40a7a099 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:26.467770 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-fd79c8c1-d1e8-406b-8acf-09ce40a7a099 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:26.474996 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fd79c8c1-d1e8-406b-8acf-09ce40a7a099 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:26.475659 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fd79c8c1-d1e8-406b-8acf-09ce40a7a099 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:26.476620 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fd79c8c1-d1e8-406b-8acf-09ce40a7a099 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:26.477218 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fd79c8c1-d1e8-406b-8acf-09ce40a7a099 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:26.486458 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-d2feae3d-6939-474a-8002-d13285907e31 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:26.497073 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-d2feae3d-6939-474a-8002-d13285907e31 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be" status: 200 len: 1314 microversion: 2.1 time: 0.269492 Jul 12 14:43:26.498598 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 239/485] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:26 2022] GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:26.670959 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-fd79c8c1-d1e8-406b-8acf-09ce40a7a099 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:26.679472 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-fd79c8c1-d1e8-406b-8acf-09ce40a7a099 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1754 microversion: 2.1 time: 0.216620 Jul 12 14:43:26.680050 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 247/486] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:26 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1754 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:27.015505 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-cd3b1d23-c563-49f7-aafd-c39594190379 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Action: 'create', calling method: .version_select at 0x7f962cb2ee50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-616226702", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOLTLF3pycbNr3XFeE/cEe/nC+km+AoKcWhV/M6+MAariPXFCZKRZFkqP9GjW0aMuEEhtP0k3K0WqpEwGHo3Mzta1lttVuJH2g0IhL3/J54gfPWEUM2CUErhFDT12M56A=="}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:43:27.030059 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-cd3b1d23-c563-49f7-aafd-c39594190379 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Getting quotas for project c361a671e3fc43c8a536f6526dc530b1. Resources: {'key_pairs'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:43:27.034138 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-cd3b1d23-c563-49f7-aafd-c39594190379 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Getting quotas for user 917bfc7c68384536a6945af83308f789 and project c361a671e3fc43c8a536f6526dc530b1. Resources: {'key_pairs'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:43:27.094072 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-cd3b1d23-c563-49f7-aafd-c39594190379 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.247493 Jul 12 14:43:27.094685 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 240/487] 10.222.0.30 () {60 vars in 1158 bytes} [Tue Jul 12 14:43:26 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:43:27.514586 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-421fc83c-89e8-4719-89ef-f3b04f9e7002 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:27.515140 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-421fc83c-89e8-4719-89ef-f3b04f9e7002 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: d89391af-dbb1-4992-8b67-5e0dee22c2be] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:27.517181 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell0:SELECT=2 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:27.518322 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell0:SELECT=8 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:27.523472 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-421fc83c-89e8-4719-89ef-f3b04f9e7002 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:27.523918 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-421fc83c-89e8-4719-89ef-f3b04f9e7002 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:27.524695 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-421fc83c-89e8-4719-89ef-f3b04f9e7002 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:27.525126 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-421fc83c-89e8-4719-89ef-f3b04f9e7002 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:27.667907 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-421fc83c-89e8-4719-89ef-f3b04f9e7002 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:27.676733 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-421fc83c-89e8-4719-89ef-f3b04f9e7002 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be" status: 200 len: 1314 microversion: 2.1 time: 0.166414 Jul 12 14:43:27.677339 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 248/488] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:27 2022] GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:27.696261 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-5dba5114-96be-48ce-ad37-505d37f173d0 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:27.696932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-5dba5114-96be-48ce-ad37-505d37f173d0 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:27.704545 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5dba5114-96be-48ce-ad37-505d37f173d0 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:27.705292 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5dba5114-96be-48ce-ad37-505d37f173d0 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:27.706063 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5dba5114-96be-48ce-ad37-505d37f173d0 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:27.706622 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5dba5114-96be-48ce-ad37-505d37f173d0 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:27.859092 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-5dba5114-96be-48ce-ad37-505d37f173d0 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:27.867901 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-5dba5114-96be-48ce-ad37-505d37f173d0 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1754 microversion: 2.1 time: 0.175913 Jul 12 14:43:27.876104 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 241/489] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:27 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:28.694468 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-13cabb27-3aef-4798-822b-4ba615063a2e tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:28.695439 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-13cabb27-3aef-4798-822b-4ba615063a2e tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: d89391af-dbb1-4992-8b67-5e0dee22c2be] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:28.703102 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-13cabb27-3aef-4798-822b-4ba615063a2e tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:28.705816 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-13cabb27-3aef-4798-822b-4ba615063a2e tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:28.705816 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-13cabb27-3aef-4798-822b-4ba615063a2e tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:28.705816 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-13cabb27-3aef-4798-822b-4ba615063a2e tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:28.860523 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-13cabb27-3aef-4798-822b-4ba615063a2e tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:28.868311 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-13cabb27-3aef-4798-822b-4ba615063a2e tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be" status: 200 len: 1314 microversion: 2.1 time: 0.177864 Jul 12 14:43:28.868841 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 249/490] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:28 2022] GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:28.886099 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-8a1f7086-1f5d-434c-9d8c-9be2f7b43dbd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:28.887222 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-8a1f7086-1f5d-434c-9d8c-9be2f7b43dbd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:28.896926 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8a1f7086-1f5d-434c-9d8c-9be2f7b43dbd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:28.897432 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8a1f7086-1f5d-434c-9d8c-9be2f7b43dbd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:28.898424 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8a1f7086-1f5d-434c-9d8c-9be2f7b43dbd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:28.898631 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8a1f7086-1f5d-434c-9d8c-9be2f7b43dbd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:29.068906 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-8a1f7086-1f5d-434c-9d8c-9be2f7b43dbd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:29.083793 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-8a1f7086-1f5d-434c-9d8c-9be2f7b43dbd tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1757 microversion: 2.1 time: 0.201922 Jul 12 14:43:29.089788 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 242/491] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:28 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1757 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:29.886028 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-022a8628-0def-4be8-873c-cbb4f53106bb tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:29.886771 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-022a8628-0def-4be8-873c-cbb4f53106bb tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: d89391af-dbb1-4992-8b67-5e0dee22c2be] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:29.893091 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-022a8628-0def-4be8-873c-cbb4f53106bb tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:29.893561 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-022a8628-0def-4be8-873c-cbb4f53106bb tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:29.894322 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-022a8628-0def-4be8-873c-cbb4f53106bb tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:29.897115 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-022a8628-0def-4be8-873c-cbb4f53106bb tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:30.038860 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-022a8628-0def-4be8-873c-cbb4f53106bb tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:30.046714 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-022a8628-0def-4be8-873c-cbb4f53106bb tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be" status: 200 len: 1314 microversion: 2.1 time: 0.164702 Jul 12 14:43:30.047281 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 250/492] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:29 2022] GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:30.320313 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-4bb3de65-f70f-43ec-bfd5-15f12a2cf1ab tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:43:30.320313 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-4bb3de65-f70f-43ec-bfd5-15f12a2cf1ab tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:30.320313 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:30.323936 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4bb3de65-f70f-43ec-bfd5-15f12a2cf1ab tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:30.324390 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4bb3de65-f70f-43ec-bfd5-15f12a2cf1ab tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:30.325198 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4bb3de65-f70f-43ec-bfd5-15f12a2cf1ab tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:30.326168 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4bb3de65-f70f-43ec-bfd5-15f12a2cf1ab tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:30.343340 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:30.349839 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.objects.instance [None req-4bb3de65-f70f-43ec-bfd5-15f12a2cf1ab tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lazy-loading 'flavor' on Instance uuid 8a9deddf-4864-4ad7-9f64-51b96f7c45eb {{(pid=129980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:43:30.436845 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e2e3d561-46d2-4c78-ade7-585e4ec2cb8b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:30.437374 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-e2e3d561-46d2-4c78-ade7-585e4ec2cb8b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:30.446275 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e2e3d561-46d2-4c78-ade7-585e4ec2cb8b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:30.446727 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e2e3d561-46d2-4c78-ade7-585e4ec2cb8b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:30.447401 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e2e3d561-46d2-4c78-ade7-585e4ec2cb8b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:30.447836 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e2e3d561-46d2-4c78-ade7-585e4ec2cb8b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:30.596325 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.objects.instance [None req-e2e3d561-46d2-4c78-ade7-585e4ec2cb8b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lazy-loading 'services' on Instance uuid b8f59b92-aa7f-496d-a19c-9035a4948560 {{(pid=129981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:43:30.724784 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-4bb3de65-f70f-43ec-bfd5-15f12a2cf1ab tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "POST /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb/action" status: 200 len: 32 microversion: 2.1 time: 0.413525 Jul 12 14:43:30.725995 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 243/493] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Jul 12 14:43:30 2022] POST /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb/action => generated 32 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 14:43:30.735872 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-6bc1f71c-cba7-4daa-9595-e0224e7bd2d4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:30.736660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-6bc1f71c-cba7-4daa-9595-e0224e7bd2d4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:30.744028 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6bc1f71c-cba7-4daa-9595-e0224e7bd2d4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:30.744476 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6bc1f71c-cba7-4daa-9595-e0224e7bd2d4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:30.745277 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6bc1f71c-cba7-4daa-9595-e0224e7bd2d4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:30.746147 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6bc1f71c-cba7-4daa-9595-e0224e7bd2d4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:30.886405 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-6bc1f71c-cba7-4daa-9595-e0224e7bd2d4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:30.895462 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-6bc1f71c-cba7-4daa-9595-e0224e7bd2d4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1735 microversion: 2.1 time: 0.164220 Jul 12 14:43:30.896058 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 244/494] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:30 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:30.908430 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-e2e3d561-46d2-4c78-ade7-585e4ec2cb8b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560/os-volume_attachments/28e328d1-cb00-478b-bb2b-be9de8e839aa" status: 202 len: 0 microversion: 2.1 time: 0.463260 Jul 12 14:43:30.909416 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 251/495] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Jul 12 14:43:30 2022] DELETE /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560/os-volume_attachments/28e328d1-cb00-478b-bb2b-be9de8e839aa => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:43:31.066934 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-abe84256-cd39-4403-b1ef-42b8059e25ff tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:31.072917 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-abe84256-cd39-4403-b1ef-42b8059e25ff tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: d89391af-dbb1-4992-8b67-5e0dee22c2be] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:31.089391 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-abe84256-cd39-4403-b1ef-42b8059e25ff tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:31.090062 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-abe84256-cd39-4403-b1ef-42b8059e25ff tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:31.091383 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-bab95fa8-a18f-4d04-8efa-a726bb74c37a req-112e0337-083e-43b6-a186-8aa2de558578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d89391af-dbb1-4992-8b67-5e0dee22c2be", "name": "network-vif-plugged", "status": "completed", "tag": "6678e823-f3e8-4d61-b5db-3f7cd99a101b"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:43:31.092299 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-abe84256-cd39-4403-b1ef-42b8059e25ff tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:31.093724 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-abe84256-cd39-4403-b1ef-42b8059e25ff tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:31.118505 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-bab95fa8-a18f-4d04-8efa-a726bb74c37a req-112e0337-083e-43b6-a186-8aa2de558578 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:31.119109 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-bab95fa8-a18f-4d04-8efa-a726bb74c37a req-112e0337-083e-43b6-a186-8aa2de558578 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:31.148945 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-bab95fa8-a18f-4d04-8efa-a726bb74c37a req-112e0337-083e-43b6-a186-8aa2de558578 service nova] Creating event network-vif-plugged:6678e823-f3e8-4d61-b5db-3f7cd99a101b for instance d89391af-dbb1-4992-8b67-5e0dee22c2be on hv-cinder-82002 Jul 12 14:43:31.160758 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-bab95fa8-a18f-4d04-8efa-a726bb74c37a req-112e0337-083e-43b6-a186-8aa2de558578 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074711 Jul 12 14:43:31.161713 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 252/496] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:43:31.363614 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-abe84256-cd39-4403-b1ef-42b8059e25ff tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:31.373504 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-abe84256-cd39-4403-b1ef-42b8059e25ff tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be" status: 200 len: 1314 microversion: 2.1 time: 0.313324 Jul 12 14:43:31.374553 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 245/497] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:31 2022] GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:31.919148 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-3864685b-880c-4846-97d3-b0d304db265e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:31.923697 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-3864685b-880c-4846-97d3-b0d304db265e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:31.930511 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3864685b-880c-4846-97d3-b0d304db265e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:31.931394 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3864685b-880c-4846-97d3-b0d304db265e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:31.932557 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3864685b-880c-4846-97d3-b0d304db265e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:31.933248 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3864685b-880c-4846-97d3-b0d304db265e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:32.188487 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-3864685b-880c-4846-97d3-b0d304db265e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:32.197336 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-3864685b-880c-4846-97d3-b0d304db265e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1735 microversion: 2.1 time: 0.287839 Jul 12 14:43:32.207884 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 253/498] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:31 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1735 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:32.398432 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-7c77b78d-3cf5-4d49-871f-73e957a7ce8f tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:32.399169 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-7c77b78d-3cf5-4d49-871f-73e957a7ce8f tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: d89391af-dbb1-4992-8b67-5e0dee22c2be] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:32.406600 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7c77b78d-3cf5-4d49-871f-73e957a7ce8f tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:32.410143 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7c77b78d-3cf5-4d49-871f-73e957a7ce8f tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:32.410143 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7c77b78d-3cf5-4d49-871f-73e957a7ce8f tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:32.410143 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7c77b78d-3cf5-4d49-871f-73e957a7ce8f tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:32.551284 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-7c77b78d-3cf5-4d49-871f-73e957a7ce8f tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:32.558959 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-7c77b78d-3cf5-4d49-871f-73e957a7ce8f tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be" status: 200 len: 1314 microversion: 2.1 time: 0.164441 Jul 12 14:43:32.559707 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 246/499] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:32 2022] GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:33.217476 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-5afbbcb5-7ce2-4c60-aa9d-0223968c3ace tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:33.218108 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-5afbbcb5-7ce2-4c60-aa9d-0223968c3ace tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:33.225639 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5afbbcb5-7ce2-4c60-aa9d-0223968c3ace tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:33.226133 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5afbbcb5-7ce2-4c60-aa9d-0223968c3ace tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:33.226779 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5afbbcb5-7ce2-4c60-aa9d-0223968c3ace tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:33.227410 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5afbbcb5-7ce2-4c60-aa9d-0223968c3ace tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:33.301640 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-856af2a0-0f79-4b8a-b1a9-8121e69c7548 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:43:33.308195 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-856af2a0-0f79-4b8a-b1a9-8121e69c7548 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:33.308649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-856af2a0-0f79-4b8a-b1a9-8121e69c7548 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:33.336177 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-856af2a0-0f79-4b8a-b1a9-8121e69c7548 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Going to try to stop instance {{(pid=129980) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 12 14:43:33.367215 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-5afbbcb5-7ce2-4c60-aa9d-0223968c3ace tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:33.376778 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-5afbbcb5-7ce2-4c60-aa9d-0223968c3ace tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1735 microversion: 2.1 time: 0.164382 Jul 12 14:43:33.377386 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 254/500] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:33 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:33.547480 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-856af2a0-0f79-4b8a-b1a9-8121e69c7548 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "POST /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560/action" status: 202 len: 0 microversion: 2.1 time: 0.253726 Jul 12 14:43:33.548122 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 247/501] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Jul 12 14:43:33 2022] POST /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 14:43:33.556203 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-488fb681-adc0-4949-adb4-a54861691369 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:33.557398 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-488fb681-adc0-4949-adb4-a54861691369 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:33.563626 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-488fb681-adc0-4949-adb4-a54861691369 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:33.564064 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-488fb681-adc0-4949-adb4-a54861691369 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:33.564862 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-488fb681-adc0-4949-adb4-a54861691369 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:33.565328 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-488fb681-adc0-4949-adb4-a54861691369 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:33.577546 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-f3e6d357-e164-41b6-8fe0-23b9351c1154 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:33.578283 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-f3e6d357-e164-41b6-8fe0-23b9351c1154 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: d89391af-dbb1-4992-8b67-5e0dee22c2be] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:33.584681 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f3e6d357-e164-41b6-8fe0-23b9351c1154 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:33.585127 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f3e6d357-e164-41b6-8fe0-23b9351c1154 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:33.585943 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f3e6d357-e164-41b6-8fe0-23b9351c1154 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:33.590967 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f3e6d357-e164-41b6-8fe0-23b9351c1154 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:34.013789 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-488fb681-adc0-4949-adb4-a54861691369 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:34.021416 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-488fb681-adc0-4949-adb4-a54861691369 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1678 microversion: 2.1 time: 0.469126 Jul 12 14:43:34.021987 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 255/502] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:33 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1678 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:34.027611 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-f3e6d357-e164-41b6-8fe0-23b9351c1154 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:34.034934 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-f3e6d357-e164-41b6-8fe0-23b9351c1154 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be" status: 200 len: 1314 microversion: 2.1 time: 0.462291 Jul 12 14:43:34.035493 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 248/503] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:33 2022] GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:34.394913 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-00d8901f-757c-4f9e-8183-cb4db6a2e28a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:34.395528 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-00d8901f-757c-4f9e-8183-cb4db6a2e28a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:34.397992 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:34.403009 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-00d8901f-757c-4f9e-8183-cb4db6a2e28a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:34.403458 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-00d8901f-757c-4f9e-8183-cb4db6a2e28a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:34.404783 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-00d8901f-757c-4f9e-8183-cb4db6a2e28a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:34.405238 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-00d8901f-757c-4f9e-8183-cb4db6a2e28a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:34.542034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-00d8901f-757c-4f9e-8183-cb4db6a2e28a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:34.549934 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-00d8901f-757c-4f9e-8183-cb4db6a2e28a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1735 microversion: 2.1 time: 0.159083 Jul 12 14:43:34.550506 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 256/504] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:34 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:35.039024 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-95283b7b-6763-4e81-b081-ae0937205f77 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:35.039654 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-95283b7b-6763-4e81-b081-ae0937205f77 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:35.046227 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-95283b7b-6763-4e81-b081-ae0937205f77 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:35.046680 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-95283b7b-6763-4e81-b081-ae0937205f77 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:35.047442 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-95283b7b-6763-4e81-b081-ae0937205f77 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:35.047881 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-95283b7b-6763-4e81-b081-ae0937205f77 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:35.052014 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-91827fc3-7253-4aa4-b7ce-2039e89da3c2 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:35.052625 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-91827fc3-7253-4aa4-b7ce-2039e89da3c2 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: d89391af-dbb1-4992-8b67-5e0dee22c2be] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:35.059822 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-91827fc3-7253-4aa4-b7ce-2039e89da3c2 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:35.060976 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-91827fc3-7253-4aa4-b7ce-2039e89da3c2 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:35.062246 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-91827fc3-7253-4aa4-b7ce-2039e89da3c2 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:35.062690 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-91827fc3-7253-4aa4-b7ce-2039e89da3c2 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:35.246803 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-95283b7b-6763-4e81-b081-ae0937205f77 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:35.255072 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-95283b7b-6763-4e81-b081-ae0937205f77 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1678 microversion: 2.1 time: 0.219937 Jul 12 14:43:35.255638 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 249/505] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:35 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1678 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:35.257991 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-91827fc3-7253-4aa4-b7ce-2039e89da3c2 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:35.269426 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-91827fc3-7253-4aa4-b7ce-2039e89da3c2 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be" status: 200 len: 1497 microversion: 2.1 time: 0.221501 Jul 12 14:43:35.270008 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 257/506] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:35 2022] GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be => generated 1497 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:35.568320 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-75b15afb-1cde-49de-9e90-a5af34f20cd4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:35.568878 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-75b15afb-1cde-49de-9e90-a5af34f20cd4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:35.575533 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-75b15afb-1cde-49de-9e90-a5af34f20cd4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:35.575977 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-75b15afb-1cde-49de-9e90-a5af34f20cd4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:35.576747 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-75b15afb-1cde-49de-9e90-a5af34f20cd4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:35.577206 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-75b15afb-1cde-49de-9e90-a5af34f20cd4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:35.708885 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-75b15afb-1cde-49de-9e90-a5af34f20cd4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:35.718479 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-75b15afb-1cde-49de-9e90-a5af34f20cd4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1735 microversion: 2.1 time: 0.154380 Jul 12 14:43:35.719060 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 250/507] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:35 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:36.273097 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-20d45029-3b74-4dd4-b013-bcad8deb242e tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:36.273967 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-20d45029-3b74-4dd4-b013-bcad8deb242e tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:36.282158 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-20d45029-3b74-4dd4-b013-bcad8deb242e tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:36.282614 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-20d45029-3b74-4dd4-b013-bcad8deb242e tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:36.283394 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-20d45029-3b74-4dd4-b013-bcad8deb242e tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:36.283828 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-20d45029-3b74-4dd4-b013-bcad8deb242e tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:36.288446 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:36.341380 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-393f0465-3cfa-47be-9668-d220ba35e8b5 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:36.341958 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-393f0465-3cfa-47be-9668-d220ba35e8b5 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: d89391af-dbb1-4992-8b67-5e0dee22c2be] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:36.348772 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-393f0465-3cfa-47be-9668-d220ba35e8b5 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:36.349257 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-393f0465-3cfa-47be-9668-d220ba35e8b5 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:36.350028 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-393f0465-3cfa-47be-9668-d220ba35e8b5 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:36.350446 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-393f0465-3cfa-47be-9668-d220ba35e8b5 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:36.379102 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-393f0465-3cfa-47be-9668-d220ba35e8b5 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: d89391af-dbb1-4992-8b67-5e0dee22c2be] Going to try to terminate instance {{(pid=129980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:43:36.425852 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-20d45029-3b74-4dd4-b013-bcad8deb242e tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:36.433979 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-20d45029-3b74-4dd4-b013-bcad8deb242e tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1678 microversion: 2.1 time: 0.164806 Jul 12 14:43:36.435450 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 258/508] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:36 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:36.680275 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-393f0465-3cfa-47be-9668-d220ba35e8b5 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be" status: 204 len: 0 microversion: 2.1 time: 0.342451 Jul 12 14:43:36.680822 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 251/509] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Jul 12 14:43:36 2022] DELETE /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 14:43:36.690635 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d30466e1-bc59-4924-996a-178ec2a6ce32 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:36.691239 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-d30466e1-bc59-4924-996a-178ec2a6ce32 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: d89391af-dbb1-4992-8b67-5e0dee22c2be] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:36.697420 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d30466e1-bc59-4924-996a-178ec2a6ce32 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:36.697871 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d30466e1-bc59-4924-996a-178ec2a6ce32 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:36.698724 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d30466e1-bc59-4924-996a-178ec2a6ce32 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:36.699157 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d30466e1-bc59-4924-996a-178ec2a6ce32 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:36.736373 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-61984d42-456a-43a9-a35d-80c71bc4081f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:36.737071 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-61984d42-456a-43a9-a35d-80c71bc4081f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:36.743333 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-61984d42-456a-43a9-a35d-80c71bc4081f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:36.743803 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-61984d42-456a-43a9-a35d-80c71bc4081f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:36.744609 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-61984d42-456a-43a9-a35d-80c71bc4081f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:36.745050 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-61984d42-456a-43a9-a35d-80c71bc4081f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:36.870608 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d30466e1-bc59-4924-996a-178ec2a6ce32 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:36.882170 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-d30466e1-bc59-4924-996a-178ec2a6ce32 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be" status: 200 len: 1503 microversion: 2.1 time: 0.193498 Jul 12 14:43:36.882170 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 259/510] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:36 2022] GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be => generated 1503 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:36.915220 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-61984d42-456a-43a9-a35d-80c71bc4081f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:36.923162 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-61984d42-456a-43a9-a35d-80c71bc4081f tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1735 microversion: 2.1 time: 0.191021 Jul 12 14:43:36.925516 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 252/511] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:36 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:37.451523 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-dfd2e52e-21be-4c70-8e3f-cfb854f5927c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:37.452135 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-dfd2e52e-21be-4c70-8e3f-cfb854f5927c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:37.459374 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-dfd2e52e-21be-4c70-8e3f-cfb854f5927c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:37.459829 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-dfd2e52e-21be-4c70-8e3f-cfb854f5927c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:37.460641 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-dfd2e52e-21be-4c70-8e3f-cfb854f5927c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:37.461075 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-dfd2e52e-21be-4c70-8e3f-cfb854f5927c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:37.595614 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-dfd2e52e-21be-4c70-8e3f-cfb854f5927c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:37.603194 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-dfd2e52e-21be-4c70-8e3f-cfb854f5927c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1678 microversion: 2.1 time: 0.155649 Jul 12 14:43:37.603752 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 260/512] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:37 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:37.897938 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ba13e4e8-9ca6-4201-8ecb-2398b9bd0cb4 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:37.898550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-ba13e4e8-9ca6-4201-8ecb-2398b9bd0cb4 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: d89391af-dbb1-4992-8b67-5e0dee22c2be] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:37.900583 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell0:SELECT=6 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:37.906469 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ba13e4e8-9ca6-4201-8ecb-2398b9bd0cb4 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:37.906918 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ba13e4e8-9ca6-4201-8ecb-2398b9bd0cb4 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:37.907685 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ba13e4e8-9ca6-4201-8ecb-2398b9bd0cb4 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:37.908121 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ba13e4e8-9ca6-4201-8ecb-2398b9bd0cb4 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:37.941425 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-71c59951-7dc7-4989-9776-4e1085a128d2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:37.942027 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-71c59951-7dc7-4989-9776-4e1085a128d2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:37.948110 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-71c59951-7dc7-4989-9776-4e1085a128d2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:37.948556 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-71c59951-7dc7-4989-9776-4e1085a128d2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:37.949342 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-71c59951-7dc7-4989-9776-4e1085a128d2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:37.949829 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-71c59951-7dc7-4989-9776-4e1085a128d2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:38.103114 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ba13e4e8-9ca6-4201-8ecb-2398b9bd0cb4 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:38.110893 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ba13e4e8-9ca6-4201-8ecb-2398b9bd0cb4 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be" status: 200 len: 1503 microversion: 2.1 time: 0.216711 Jul 12 14:43:38.118548 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 253/513] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:37 2022] GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be => generated 1503 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:38.132086 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-71c59951-7dc7-4989-9776-4e1085a128d2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:38.140953 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-71c59951-7dc7-4989-9776-4e1085a128d2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1735 microversion: 2.1 time: 0.203265 Jul 12 14:43:38.141559 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 261/514] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:37 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1735 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:38.620719 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-df6d05ff-1ee2-490d-bb79-486ff0b44bb6 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:38.621631 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-df6d05ff-1ee2-490d-bb79-486ff0b44bb6 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:38.627739 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-df6d05ff-1ee2-490d-bb79-486ff0b44bb6 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:38.628190 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-df6d05ff-1ee2-490d-bb79-486ff0b44bb6 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:38.628957 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-df6d05ff-1ee2-490d-bb79-486ff0b44bb6 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:38.629427 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-df6d05ff-1ee2-490d-bb79-486ff0b44bb6 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:38.764291 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-df6d05ff-1ee2-490d-bb79-486ff0b44bb6 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:38.771863 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-df6d05ff-1ee2-490d-bb79-486ff0b44bb6 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1678 microversion: 2.1 time: 0.155016 Jul 12 14:43:38.772448 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 254/515] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:38 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:39.127445 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e0896334-de13-4982-b280-887593496f4e tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:39.128049 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-e0896334-de13-4982-b280-887593496f4e tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: d89391af-dbb1-4992-8b67-5e0dee22c2be] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:39.134626 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e0896334-de13-4982-b280-887593496f4e tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:39.135066 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e0896334-de13-4982-b280-887593496f4e tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:39.135812 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e0896334-de13-4982-b280-887593496f4e tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:39.136240 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e0896334-de13-4982-b280-887593496f4e tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:39.157880 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-f69cdf7a-15e2-40e1-9b20-cd31d70557be tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:39.158495 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-f69cdf7a-15e2-40e1-9b20-cd31d70557be tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:39.164979 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f69cdf7a-15e2-40e1-9b20-cd31d70557be tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:39.165469 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f69cdf7a-15e2-40e1-9b20-cd31d70557be tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:39.166278 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f69cdf7a-15e2-40e1-9b20-cd31d70557be tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:39.166725 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f69cdf7a-15e2-40e1-9b20-cd31d70557be tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:39.185392 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:39.445237 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e0896334-de13-4982-b280-887593496f4e tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:39.465720 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-f69cdf7a-15e2-40e1-9b20-cd31d70557be tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:39.467517 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-e0896334-de13-4982-b280-887593496f4e tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be" status: 200 len: 1503 microversion: 2.1 time: 0.343913 Jul 12 14:43:39.468309 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 262/516] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:39 2022] GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be => generated 1503 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:39.475196 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-f69cdf7a-15e2-40e1-9b20-cd31d70557be tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1735 microversion: 2.1 time: 0.321676 Jul 12 14:43:39.485100 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 255/517] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:39 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1735 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:39.789447 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-1324365f-5600-4725-8693-09d28bd0bbb0 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:39.790091 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-1324365f-5600-4725-8693-09d28bd0bbb0 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:39.796410 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1324365f-5600-4725-8693-09d28bd0bbb0 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:39.796854 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1324365f-5600-4725-8693-09d28bd0bbb0 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:39.797650 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1324365f-5600-4725-8693-09d28bd0bbb0 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:39.798080 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1324365f-5600-4725-8693-09d28bd0bbb0 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:39.957889 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-fc714d8d-d966-4a65-926d-2773e06e278e req-be137aba-5705-4716-aa22-89deb7c86ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d89391af-dbb1-4992-8b67-5e0dee22c2be", "name": "network-vif-deleted", "tag": "6678e823-f3e8-4d61-b5db-3f7cd99a101b"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:43:39.970856 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-fc714d8d-d966-4a65-926d-2773e06e278e req-be137aba-5705-4716-aa22-89deb7c86ad2 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:39.975648 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-fc714d8d-d966-4a65-926d-2773e06e278e req-be137aba-5705-4716-aa22-89deb7c86ad2 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:39.985067 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-fc714d8d-d966-4a65-926d-2773e06e278e req-be137aba-5705-4716-aa22-89deb7c86ad2 service nova] Creating event network-vif-deleted:6678e823-f3e8-4d61-b5db-3f7cd99a101b for instance d89391af-dbb1-4992-8b67-5e0dee22c2be on hv-cinder-82002 Jul 12 14:43:39.992379 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-fc714d8d-d966-4a65-926d-2773e06e278e req-be137aba-5705-4716-aa22-89deb7c86ad2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038695 Jul 12 14:43:39.993246 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 256/518] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:43:40.004235 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-1324365f-5600-4725-8693-09d28bd0bbb0 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:40.011911 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-1324365f-5600-4725-8693-09d28bd0bbb0 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1678 microversion: 2.1 time: 0.226363 Jul 12 14:43:40.012481 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 263/519] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:39 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1678 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:40.486083 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-eb7ffd7a-d174-4998-bb4b-9d509a50b1e1 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:40.486787 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-eb7ffd7a-d174-4998-bb4b-9d509a50b1e1 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: d89391af-dbb1-4992-8b67-5e0dee22c2be] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:40.493197 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-eb7ffd7a-d174-4998-bb4b-9d509a50b1e1 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:40.493657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-eb7ffd7a-d174-4998-bb4b-9d509a50b1e1 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:40.494434 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-eb7ffd7a-d174-4998-bb4b-9d509a50b1e1 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:40.494883 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-eb7ffd7a-d174-4998-bb4b-9d509a50b1e1 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:40.495890 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-56f5b54a-7466-433f-aadc-42f3c135d2c0 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:40.496854 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-56f5b54a-7466-433f-aadc-42f3c135d2c0 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:40.504308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-56f5b54a-7466-433f-aadc-42f3c135d2c0 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:40.505010 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-56f5b54a-7466-433f-aadc-42f3c135d2c0 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:40.506159 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-56f5b54a-7466-433f-aadc-42f3c135d2c0 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:40.506656 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-56f5b54a-7466-433f-aadc-42f3c135d2c0 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:40.529480 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-eb7ffd7a-d174-4998-bb4b-9d509a50b1e1 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:40.529932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-eb7ffd7a-d174-4998-bb4b-9d509a50b1e1 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:40.530384 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.objects.instance [None req-eb7ffd7a-d174-4998-bb4b-9d509a50b1e1 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lazy-loading 'fault' on Instance uuid d89391af-dbb1-4992-8b67-5e0dee22c2be {{(pid=129980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:43:40.595847 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-eb7ffd7a-d174-4998-bb4b-9d509a50b1e1 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:40.603967 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-eb7ffd7a-d174-4998-bb4b-9d509a50b1e1 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be" status: 200 len: 1304 microversion: 2.1 time: 0.123058 Jul 12 14:43:40.604581 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 257/520] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:40 2022] GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:40.665896 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-56f5b54a-7466-433f-aadc-42f3c135d2c0 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:40.674326 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-56f5b54a-7466-433f-aadc-42f3c135d2c0 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1735 microversion: 2.1 time: 0.185501 Jul 12 14:43:40.674986 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 264/521] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:40 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:41.030041 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-b03028e2-35a7-468c-83de-d9cb634230c3 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:41.030662 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-b03028e2-35a7-468c-83de-d9cb634230c3 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:41.038949 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b03028e2-35a7-468c-83de-d9cb634230c3 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:41.038949 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b03028e2-35a7-468c-83de-d9cb634230c3 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:41.038949 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b03028e2-35a7-468c-83de-d9cb634230c3 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:41.038949 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b03028e2-35a7-468c-83de-d9cb634230c3 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:41.177556 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-b03028e2-35a7-468c-83de-d9cb634230c3 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:41.185254 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-b03028e2-35a7-468c-83de-d9cb634230c3 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1678 microversion: 2.1 time: 0.159516 Jul 12 14:43:41.188086 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 258/522] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:41 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:41.622103 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-63ffa894-4a9f-4116-baf1-98697aa52e75 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:41.626970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-63ffa894-4a9f-4116-baf1-98697aa52e75 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: d89391af-dbb1-4992-8b67-5e0dee22c2be] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:41.630388 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-63ffa894-4a9f-4116-baf1-98697aa52e75 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:41.630834 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-63ffa894-4a9f-4116-baf1-98697aa52e75 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:41.631595 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-63ffa894-4a9f-4116-baf1-98697aa52e75 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:41.632035 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-63ffa894-4a9f-4116-baf1-98697aa52e75 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:41.647051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.wsgi [None req-63ffa894-4a9f-4116-baf1-98697aa52e75 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] HTTP exception thrown: Instance d89391af-dbb1-4992-8b67-5e0dee22c2be could not be found. Jul 12 14:43:41.649738 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-63ffa894-4a9f-4116-baf1-98697aa52e75 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Request method failure captured: Jul 12 14:43:41.649738 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be HTTP/1.1 Jul 12 14:43:41.649738 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:43:41.649738 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:43:41.649738 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:43:41.649738 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 0 Jul 12 14:43:41.649738 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:43:41.649738 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:43:41.649738 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:43:41.649738 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:43:41.649738 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYiCLM_38mkmVin9r-oqk91B_IBaiKT60qR9z3S2VZ3cFFWWGvJD7q-ZR7IqXNK_rjqJFxDIEyTo9b4v0fIapNIB5T2wQwW6xmRojXTf3RVcI_Xu4nAlr2mK9Svkshk7VKdN3YIElHDEa9-a6k5hgAkTqyMcgEmRXXOX-1enQDxW2s0 Jul 12 14:43:41.649738 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:43:41.649738 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:43:41.649738 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:43:41.649738 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:43:41.649738 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:43:41.649738 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:43:41.649738 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: 1f15caa06dac4f2b952ff64f9e9e74ca Jul 12 14:43:41.649738 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-VolumesActionsTest-2122839514 Jul 12 14:43:41.649738 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:43:41.649738 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:43:41.651331 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f15caa06dac4f2b952ff64f9e9e74ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1f15caa06dac4f2b952ff64f9e9e74ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f15caa06dac4f2b952ff64f9e9e74ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1f15caa06dac4f2b952ff64f9e9e74ca", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:43:41.651331 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-VolumesActionsTest-2122839514 Jul 12 14:43:41.651331 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: 1f15caa06dac4f2b952ff64f9e9e74ca Jul 12 14:43:41.651331 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-VolumesActionsTest-2122839514 Jul 12 14:43:41.651331 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-VolumesActionsTest-2122839514-project Jul 12 14:43:41.651331 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:43:41.651331 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:43:41.651331 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: 9ac06a23a9b84ec38e0712bad9046762 Jul 12 14:43:41.651331 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-VolumesActionsTest-2122839514-project Jul 12 14:43:41.651331 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: > Jul 12 14:43:41.651331 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Instance d89391af-dbb1-4992-8b67-5e0dee22c2be could not be found. Jul 12 14:43:41.651331 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'id': 'd89391af-dbb1-4992-8b67-5e0dee22c2be'} Jul 12 14:43:41.652308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:43:41.652308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:43:41.652308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:43:41.652308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:43:41.652308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:43:41.652308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:43:41.652308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:43:41.652308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:43:41.652308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:43:41.652308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:43:41.652308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d89391af-dbb1-4992-8b67-5e0dee22c2be could not be found. Jul 12 14:43:41.652308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:43:41.652308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:43:41.652308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:43:41.652308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:43:41.652308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:43:41.652308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:43:41.652308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:43:41.652308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:43:41.652308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:43:41.653845 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:43:41.653845 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:43:41.653845 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:43:41.653845 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:43:41.653845 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:43:41.653845 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:43:41.653845 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:43:41.653845 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d89391af-dbb1-4992-8b67-5e0dee22c2be could not be found. Jul 12 14:43:41.653845 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:43:41.653845 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:43:41.653845 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:43:41.653845 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:43:41.653845 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:43:41.653845 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:43:41.653845 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:43:41.653845 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:43:41.653845 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d89391af-dbb1-4992-8b67-5e0dee22c2be could not be found. Jul 12 14:43:41.653845 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:43:41.655700 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-63ffa894-4a9f-4116-baf1-98697aa52e75 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Returning 404 to user: Instance d89391af-dbb1-4992-8b67-5e0dee22c2be could not be found. {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:43:41.655700 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-63ffa894-4a9f-4116-baf1-98697aa52e75 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be" status: 404 len: 111 microversion: 2.1 time: 0.032159 Jul 12 14:43:41.655700 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 265/523] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:41 2022] GET /compute/v2.1/servers/d89391af-dbb1-4992-8b67-5e0dee22c2be => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:43:41.691876 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-9d4682b1-f12c-4cdd-9a3e-cb0c9e377334 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:41.692559 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-9d4682b1-f12c-4cdd-9a3e-cb0c9e377334 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:41.699112 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9d4682b1-f12c-4cdd-9a3e-cb0c9e377334 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:41.699501 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9d4682b1-f12c-4cdd-9a3e-cb0c9e377334 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:41.700272 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9d4682b1-f12c-4cdd-9a3e-cb0c9e377334 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:41.700715 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9d4682b1-f12c-4cdd-9a3e-cb0c9e377334 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:41.751037 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-47af9d69-fe16-4d64-914f-46155856dff1 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-501252492", "imageRef": "a66ccacb-7b1e-4f51-9eaf-069a356e0fdb", "flavorRef": "452", "networks": [{"uuid": "1d62481f-a360-40af-871f-8e152ec500d6"}]}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:43:41.807445 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.network.neutron [None req-47af9d69-fe16-4d64-914f-46155856dff1 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] validate_networks() for [('1d62481f-a360-40af-871f-8e152ec500d6', None, None, None, None, None)] {{(pid=129981) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:43:41.915934 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-9d4682b1-f12c-4cdd-9a3e-cb0c9e377334 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:41.925649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-9d4682b1-f12c-4cdd-9a3e-cb0c9e377334 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1735 microversion: 2.1 time: 0.237706 Jul 12 14:43:41.926386 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 259/524] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:41 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1735 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:42.190566 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-47af9d69-fe16-4d64-914f-46155856dff1 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Flavor limits 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:43:42.190993 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-47af9d69-fe16-4d64-914f-46155856dff1 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Image limits 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:43:42.191472 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-47af9d69-fe16-4d64-914f-46155856dff1 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Flavor pref 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:43:42.191884 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-47af9d69-fe16-4d64-914f-46155856dff1 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Image pref 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:43:42.192299 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-47af9d69-fe16-4d64-914f-46155856dff1 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:43:42.201913 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-47af9d69-fe16-4d64-914f-46155856dff1 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:42.202354 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-8aed29ab-0381-46c5-8eae-0112d5676842 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:42.202471 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-47af9d69-fe16-4d64-914f-46155856dff1 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:42.202991 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-8aed29ab-0381-46c5-8eae-0112d5676842 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:42.203298 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-47af9d69-fe16-4d64-914f-46155856dff1 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:42.203832 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-47af9d69-fe16-4d64-914f-46155856dff1 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:42.209637 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8aed29ab-0381-46c5-8eae-0112d5676842 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:42.210521 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8aed29ab-0381-46c5-8eae-0112d5676842 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:42.211303 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8aed29ab-0381-46c5-8eae-0112d5676842 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:42.211744 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8aed29ab-0381-46c5-8eae-0112d5676842 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:42.223051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.quota [None req-47af9d69-fe16-4d64-914f-46155856dff1 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Getting quotas for project 1f15caa06dac4f2b952ff64f9e9e74ca. Resources: {'instances', 'cores', 'ram'} {{(pid=129981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:43:42.227315 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.quota [None req-47af9d69-fe16-4d64-914f-46155856dff1 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Getting quotas for user 9ac06a23a9b84ec38e0712bad9046762 and project 1f15caa06dac4f2b952ff64f9e9e74ca. Resources: {'instances', 'cores', 'ram'} {{(pid=129981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:43:42.239081 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-47af9d69-fe16-4d64-914f-46155856dff1 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Going to run 1 instances... {{(pid=129981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:43:42.243606 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-47af9d69-fe16-4d64-914f-46155856dff1 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: 10a574c3-5f25-48a6-99e9-464bf90937a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a66ccacb-7b1e-4f51-9eaf-069a356e0fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:43:42.351728 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-8aed29ab-0381-46c5-8eae-0112d5676842 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:42.359251 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-8aed29ab-0381-46c5-8eae-0112d5676842 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1678 microversion: 2.1 time: 0.161302 Jul 12 14:43:42.359812 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 260/525] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:42 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:42.417010 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-47af9d69-fe16-4d64-914f-46155856dff1 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.670330 Jul 12 14:43:42.417737 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 266/526] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Jul 12 14:43:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 14:43:42.428954 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-c6f81bc7-988b-40cb-93a0-9b953fa35885 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:42.430505 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-c6f81bc7-988b-40cb-93a0-9b953fa35885 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: 10a574c3-5f25-48a6-99e9-464bf90937a9] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:42.489897 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-c6f81bc7-988b-40cb-93a0-9b953fa35885 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:42.499056 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-c6f81bc7-988b-40cb-93a0-9b953fa35885 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9" status: 200 len: 1213 microversion: 2.1 time: 0.074223 Jul 12 14:43:42.499628 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 261/527] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:42 2022] GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9 => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:42.944417 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-11e7f611-010a-4bbd-8a37-dda1095c0c16 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:42.945035 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-11e7f611-010a-4bbd-8a37-dda1095c0c16 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:42.951417 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-11e7f611-010a-4bbd-8a37-dda1095c0c16 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:42.951865 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-11e7f611-010a-4bbd-8a37-dda1095c0c16 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:42.952641 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-11e7f611-010a-4bbd-8a37-dda1095c0c16 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:42.953108 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-11e7f611-010a-4bbd-8a37-dda1095c0c16 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:43.093204 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-11e7f611-010a-4bbd-8a37-dda1095c0c16 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:43.101427 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-11e7f611-010a-4bbd-8a37-dda1095c0c16 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1735 microversion: 2.1 time: 0.161318 Jul 12 14:43:43.102001 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 267/528] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:42 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:43.377086 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-4e7ed716-dedb-4fe2-92ca-95b65f3588e7 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:43.377826 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-4e7ed716-dedb-4fe2-92ca-95b65f3588e7 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:43.384269 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4e7ed716-dedb-4fe2-92ca-95b65f3588e7 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:43.384737 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4e7ed716-dedb-4fe2-92ca-95b65f3588e7 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:43.385509 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4e7ed716-dedb-4fe2-92ca-95b65f3588e7 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:43.385941 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4e7ed716-dedb-4fe2-92ca-95b65f3588e7 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:43.516775 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-fe3f3373-bff8-4171-b580-436aec8b9588 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:43.517467 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-fe3f3373-bff8-4171-b580-436aec8b9588 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: 10a574c3-5f25-48a6-99e9-464bf90937a9] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:43.521609 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-4e7ed716-dedb-4fe2-92ca-95b65f3588e7 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:43.524011 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fe3f3373-bff8-4171-b580-436aec8b9588 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:43.526900 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fe3f3373-bff8-4171-b580-436aec8b9588 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:43.526900 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fe3f3373-bff8-4171-b580-436aec8b9588 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:43.526900 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fe3f3373-bff8-4171-b580-436aec8b9588 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:43.529605 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-4e7ed716-dedb-4fe2-92ca-95b65f3588e7 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1678 microversion: 2.1 time: 0.156466 Jul 12 14:43:43.530400 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 262/529] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:43 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:43.587448 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-fe3f3373-bff8-4171-b580-436aec8b9588 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:43.595903 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-fe3f3373-bff8-4171-b580-436aec8b9588 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9" status: 200 len: 1217 microversion: 2.1 time: 0.083887 Jul 12 14:43:43.596477 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 268/530] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:43 2022] GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:44.118098 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ecf61886-5686-4929-97f9-1bec159a54d7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:44.123853 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-ecf61886-5686-4929-97f9-1bec159a54d7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:44.125660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ecf61886-5686-4929-97f9-1bec159a54d7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:44.126107 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ecf61886-5686-4929-97f9-1bec159a54d7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:44.126864 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ecf61886-5686-4929-97f9-1bec159a54d7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:44.127297 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ecf61886-5686-4929-97f9-1bec159a54d7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:44.262296 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ecf61886-5686-4929-97f9-1bec159a54d7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:44.270823 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ecf61886-5686-4929-97f9-1bec159a54d7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1735 microversion: 2.1 time: 0.156638 Jul 12 14:43:44.271391 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 263/531] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:44 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:44.547081 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-71921c94-b8e2-4a51-b94a-2010747fe5bb tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:44.547685 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-71921c94-b8e2-4a51-b94a-2010747fe5bb tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:44.554181 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-71921c94-b8e2-4a51-b94a-2010747fe5bb tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:44.554621 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-71921c94-b8e2-4a51-b94a-2010747fe5bb tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:44.555460 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-71921c94-b8e2-4a51-b94a-2010747fe5bb tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:44.555898 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-71921c94-b8e2-4a51-b94a-2010747fe5bb tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:44.611967 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-f9e0ca27-bb90-4a31-bff5-721fe0bbb794 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:44.612518 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-f9e0ca27-bb90-4a31-bff5-721fe0bbb794 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: 10a574c3-5f25-48a6-99e9-464bf90937a9] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:44.619756 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f9e0ca27-bb90-4a31-bff5-721fe0bbb794 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:44.620438 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f9e0ca27-bb90-4a31-bff5-721fe0bbb794 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:44.621222 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f9e0ca27-bb90-4a31-bff5-721fe0bbb794 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:44.621965 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f9e0ca27-bb90-4a31-bff5-721fe0bbb794 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:44.690191 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-f9e0ca27-bb90-4a31-bff5-721fe0bbb794 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:44.697397 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-f9e0ca27-bb90-4a31-bff5-721fe0bbb794 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9" status: 200 len: 1265 microversion: 2.1 time: 0.089383 Jul 12 14:43:44.697962 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 264/532] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:44 2022] GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9 => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:44.710969 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-71921c94-b8e2-4a51-b94a-2010747fe5bb tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:44.719085 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-71921c94-b8e2-4a51-b94a-2010747fe5bb tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1678 microversion: 2.1 time: 0.175861 Jul 12 14:43:44.719656 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 269/533] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:44 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:45.287776 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-92612730-36f3-4280-aa99-81309daf21b3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:45.288418 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-92612730-36f3-4280-aa99-81309daf21b3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:45.294434 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-92612730-36f3-4280-aa99-81309daf21b3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:45.294896 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-92612730-36f3-4280-aa99-81309daf21b3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:45.295669 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-92612730-36f3-4280-aa99-81309daf21b3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:45.296110 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-92612730-36f3-4280-aa99-81309daf21b3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:45.498433 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-92612730-36f3-4280-aa99-81309daf21b3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:45.508173 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-92612730-36f3-4280-aa99-81309daf21b3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1735 microversion: 2.1 time: 0.223984 Jul 12 14:43:45.518549 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 265/534] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:45 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:45.714230 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e9d1186d-44fb-49ce-810d-72ae46e37f90 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:45.714846 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-e9d1186d-44fb-49ce-810d-72ae46e37f90 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: 10a574c3-5f25-48a6-99e9-464bf90937a9] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:45.722023 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e9d1186d-44fb-49ce-810d-72ae46e37f90 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:45.722502 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e9d1186d-44fb-49ce-810d-72ae46e37f90 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:45.723258 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e9d1186d-44fb-49ce-810d-72ae46e37f90 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:45.723704 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e9d1186d-44fb-49ce-810d-72ae46e37f90 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:45.735981 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-f391ba61-f01f-4695-bb28-ccdfaf890f1c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:45.736942 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-f391ba61-f01f-4695-bb28-ccdfaf890f1c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:45.743381 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f391ba61-f01f-4695-bb28-ccdfaf890f1c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:45.743829 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f391ba61-f01f-4695-bb28-ccdfaf890f1c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:45.744590 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f391ba61-f01f-4695-bb28-ccdfaf890f1c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:45.745262 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f391ba61-f01f-4695-bb28-ccdfaf890f1c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:45.802307 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e9d1186d-44fb-49ce-810d-72ae46e37f90 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:45.813574 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-e9d1186d-44fb-49ce-810d-72ae46e37f90 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9" status: 200 len: 1271 microversion: 2.1 time: 0.102656 Jul 12 14:43:45.814552 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 270/535] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:45 2022] GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9 => generated 1271 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:45.959230 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-f391ba61-f01f-4695-bb28-ccdfaf890f1c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:45.966811 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-f391ba61-f01f-4695-bb28-ccdfaf890f1c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1678 microversion: 2.1 time: 0.234950 Jul 12 14:43:45.967379 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 266/536] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:45 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1678 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:46.525664 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-7745681c-5fc5-444d-ba87-769d0a2a1675 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:46.526494 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-7745681c-5fc5-444d-ba87-769d0a2a1675 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:46.533242 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7745681c-5fc5-444d-ba87-769d0a2a1675 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:46.539940 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7745681c-5fc5-444d-ba87-769d0a2a1675 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:46.539940 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7745681c-5fc5-444d-ba87-769d0a2a1675 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:46.539940 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7745681c-5fc5-444d-ba87-769d0a2a1675 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:46.739049 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7745681c-5fc5-444d-ba87-769d0a2a1675 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:46.747541 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-7745681c-5fc5-444d-ba87-769d0a2a1675 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1735 microversion: 2.1 time: 0.225787 Jul 12 14:43:46.748127 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 271/537] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:46 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1735 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:46.830802 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-756e9bbc-ac51-4fcc-b17c-c8c26ab0f4ca tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:46.831447 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-756e9bbc-ac51-4fcc-b17c-c8c26ab0f4ca tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: 10a574c3-5f25-48a6-99e9-464bf90937a9] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:46.837972 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-756e9bbc-ac51-4fcc-b17c-c8c26ab0f4ca tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:46.838428 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-756e9bbc-ac51-4fcc-b17c-c8c26ab0f4ca tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:46.839192 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-756e9bbc-ac51-4fcc-b17c-c8c26ab0f4ca tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:46.839632 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-756e9bbc-ac51-4fcc-b17c-c8c26ab0f4ca tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:46.968555 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-61f19175-1617-4cd8-845a-294bbd8766b9 req-5ea9ee3a-301e-43ae-8de2-dee6928d120a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10a574c3-5f25-48a6-99e9-464bf90937a9", "tag": "a9b41b76-40cb-4f1e-b372-47ead7214e4f"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:43:46.978523 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-61f19175-1617-4cd8-845a-294bbd8766b9 req-5ea9ee3a-301e-43ae-8de2-dee6928d120a service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:46.978523 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-61f19175-1617-4cd8-845a-294bbd8766b9 req-5ea9ee3a-301e-43ae-8de2-dee6928d120a service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:46.990519 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-61f19175-1617-4cd8-845a-294bbd8766b9 req-5ea9ee3a-301e-43ae-8de2-dee6928d120a service nova] Creating event network-changed:a9b41b76-40cb-4f1e-b372-47ead7214e4f for instance 10a574c3-5f25-48a6-99e9-464bf90937a9 on hv-cinder-82002 Jul 12 14:43:46.995415 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-61f19175-1617-4cd8-845a-294bbd8766b9 req-5ea9ee3a-301e-43ae-8de2-dee6928d120a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030521 Jul 12 14:43:46.996170 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 272/538] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:43:47.001874 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-1c27c33e-156d-49ac-be32-354373ee13b8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:47.002632 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-1c27c33e-156d-49ac-be32-354373ee13b8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:47.009781 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1c27c33e-156d-49ac-be32-354373ee13b8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:47.010237 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1c27c33e-156d-49ac-be32-354373ee13b8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:47.011095 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1c27c33e-156d-49ac-be32-354373ee13b8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:47.011536 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1c27c33e-156d-49ac-be32-354373ee13b8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:47.030329 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-756e9bbc-ac51-4fcc-b17c-c8c26ab0f4ca tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:47.038930 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-756e9bbc-ac51-4fcc-b17c-c8c26ab0f4ca tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9" status: 200 len: 1313 microversion: 2.1 time: 0.211768 Jul 12 14:43:47.039689 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 267/539] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:46 2022] GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:47.201641 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-1c27c33e-156d-49ac-be32-354373ee13b8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:47.209187 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-1c27c33e-156d-49ac-be32-354373ee13b8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1678 microversion: 2.1 time: 0.211748 Jul 12 14:43:47.209777 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 273/540] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:46 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1678 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:47.765376 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0cfadd26-40b4-477c-bd5a-e98cb1f4747a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:47.765913 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-0cfadd26-40b4-477c-bd5a-e98cb1f4747a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:47.771843 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0cfadd26-40b4-477c-bd5a-e98cb1f4747a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:47.772286 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0cfadd26-40b4-477c-bd5a-e98cb1f4747a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:47.773045 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0cfadd26-40b4-477c-bd5a-e98cb1f4747a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:47.773515 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0cfadd26-40b4-477c-bd5a-e98cb1f4747a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:47.943012 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-0cfadd26-40b4-477c-bd5a-e98cb1f4747a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:47.951105 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-0cfadd26-40b4-477c-bd5a-e98cb1f4747a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1735 microversion: 2.1 time: 0.189709 Jul 12 14:43:47.951706 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 268/541] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:47 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:48.056004 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-027fa145-5f07-46e2-b39e-1acc2b5e8da2 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:48.056547 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-027fa145-5f07-46e2-b39e-1acc2b5e8da2 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: 10a574c3-5f25-48a6-99e9-464bf90937a9] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:48.063728 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-027fa145-5f07-46e2-b39e-1acc2b5e8da2 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:48.064171 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-027fa145-5f07-46e2-b39e-1acc2b5e8da2 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:48.064958 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-027fa145-5f07-46e2-b39e-1acc2b5e8da2 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:48.065413 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-027fa145-5f07-46e2-b39e-1acc2b5e8da2 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:48.198042 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-027fa145-5f07-46e2-b39e-1acc2b5e8da2 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:48.205853 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-027fa145-5f07-46e2-b39e-1acc2b5e8da2 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9" status: 200 len: 1313 microversion: 2.1 time: 0.153781 Jul 12 14:43:48.206417 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 274/542] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:48 2022] GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:48.225839 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-686aaaa4-232d-405c-a488-f24456c8f0bc tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:48.226450 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-686aaaa4-232d-405c-a488-f24456c8f0bc tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:48.232435 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-686aaaa4-232d-405c-a488-f24456c8f0bc tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:48.232886 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-686aaaa4-232d-405c-a488-f24456c8f0bc tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:48.233682 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-686aaaa4-232d-405c-a488-f24456c8f0bc tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:48.234120 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-686aaaa4-232d-405c-a488-f24456c8f0bc tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:48.366591 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-686aaaa4-232d-405c-a488-f24456c8f0bc tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:48.374469 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-686aaaa4-232d-405c-a488-f24456c8f0bc tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1678 microversion: 2.1 time: 0.152435 Jul 12 14:43:48.375042 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 269/543] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:48 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:48.967810 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-f7a9c318-e5b9-4a18-8e76-68a484798751 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:48.968414 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-f7a9c318-e5b9-4a18-8e76-68a484798751 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:48.974574 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f7a9c318-e5b9-4a18-8e76-68a484798751 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:48.975022 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f7a9c318-e5b9-4a18-8e76-68a484798751 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:48.975774 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f7a9c318-e5b9-4a18-8e76-68a484798751 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:48.976209 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f7a9c318-e5b9-4a18-8e76-68a484798751 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:49.108699 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-f7a9c318-e5b9-4a18-8e76-68a484798751 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:49.117489 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-f7a9c318-e5b9-4a18-8e76-68a484798751 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1735 microversion: 2.1 time: 0.153521 Jul 12 14:43:49.118060 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 275/544] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:48 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:49.223107 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-22699a1e-e0f7-42d0-92c7-8e3a1493f654 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:49.223628 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-22699a1e-e0f7-42d0-92c7-8e3a1493f654 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: 10a574c3-5f25-48a6-99e9-464bf90937a9] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:49.230123 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-22699a1e-e0f7-42d0-92c7-8e3a1493f654 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:49.230574 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-22699a1e-e0f7-42d0-92c7-8e3a1493f654 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:49.231332 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-22699a1e-e0f7-42d0-92c7-8e3a1493f654 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:49.231769 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-22699a1e-e0f7-42d0-92c7-8e3a1493f654 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:49.392662 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-f24fc10d-ae42-4c1d-96e4-61ba2f201c88 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:49.393552 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-f24fc10d-ae42-4c1d-96e4-61ba2f201c88 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:49.399924 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f24fc10d-ae42-4c1d-96e4-61ba2f201c88 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:49.400516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f24fc10d-ae42-4c1d-96e4-61ba2f201c88 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:49.401143 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f24fc10d-ae42-4c1d-96e4-61ba2f201c88 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:49.401672 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f24fc10d-ae42-4c1d-96e4-61ba2f201c88 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:49.608320 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-22699a1e-e0f7-42d0-92c7-8e3a1493f654 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:49.616393 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-22699a1e-e0f7-42d0-92c7-8e3a1493f654 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9" status: 200 len: 1313 microversion: 2.1 time: 0.397690 Jul 12 14:43:49.618859 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 270/545] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:49 2022] GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9 => generated 1313 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:49.690587 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-f24fc10d-ae42-4c1d-96e4-61ba2f201c88 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:49.694172 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=100 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:49.698581 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-f24fc10d-ae42-4c1d-96e4-61ba2f201c88 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1678 microversion: 2.1 time: 0.310509 Jul 12 14:43:49.704936 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 276/546] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:49 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1678 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:50.134837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-8b8c649d-86a7-4a29-9b98-9433a6a7acea tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:50.135452 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-8b8c649d-86a7-4a29-9b98-9433a6a7acea tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:50.142143 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8b8c649d-86a7-4a29-9b98-9433a6a7acea tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:50.142591 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8b8c649d-86a7-4a29-9b98-9433a6a7acea tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:50.143352 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8b8c649d-86a7-4a29-9b98-9433a6a7acea tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:50.143820 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8b8c649d-86a7-4a29-9b98-9433a6a7acea tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:50.272000 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-8b8c649d-86a7-4a29-9b98-9433a6a7acea tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:50.279988 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-8b8c649d-86a7-4a29-9b98-9433a6a7acea tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1735 microversion: 2.1 time: 0.149016 Jul 12 14:43:50.280557 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 271/547] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:50 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:50.590682 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-97eefbfa-de9d-4b87-ba57-953626dc82a5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1069291920", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-616226702", "security_groups": [{"name": "tempest-secgroup-smoke-1839065815"}], "block_device_mapping_v2": [{"uuid": "93dd7901-5dd0-4397-bc70-7a4faa8ad307", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "053ecff6-71cf-4863-84fc-402dc3a5230b"}]}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:43:50.636582 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-6ad8f26d-bf71-495f-95c8-5688f851a16d tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:50.636582 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-6ad8f26d-bf71-495f-95c8-5688f851a16d tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: 10a574c3-5f25-48a6-99e9-464bf90937a9] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:50.640895 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6ad8f26d-bf71-495f-95c8-5688f851a16d tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:50.641934 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6ad8f26d-bf71-495f-95c8-5688f851a16d tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:50.642697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6ad8f26d-bf71-495f-95c8-5688f851a16d tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:50.643135 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6ad8f26d-bf71-495f-95c8-5688f851a16d tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:50.737226 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.network.neutron [None req-97eefbfa-de9d-4b87-ba57-953626dc82a5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] validate_networks() for [('053ecff6-71cf-4863-84fc-402dc3a5230b', None, None, None, None, None)] {{(pid=129981) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:43:50.862647 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-6ad8f26d-bf71-495f-95c8-5688f851a16d tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:50.871403 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-6ad8f26d-bf71-495f-95c8-5688f851a16d tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9" status: 200 len: 1313 microversion: 2.1 time: 0.240730 Jul 12 14:43:50.872264 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 272/548] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:50 2022] GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9 => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:50.877456 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-da942333-eeae-4c1b-8323-6aed860f7601 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:50.878064 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-da942333-eeae-4c1b-8323-6aed860f7601 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:50.884040 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-da942333-eeae-4c1b-8323-6aed860f7601 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:50.885090 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-da942333-eeae-4c1b-8323-6aed860f7601 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:50.885902 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-da942333-eeae-4c1b-8323-6aed860f7601 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:50.886508 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-da942333-eeae-4c1b-8323-6aed860f7601 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:50.906849 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=100 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:51.118080 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-da942333-eeae-4c1b-8323-6aed860f7601 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:51.126585 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-da942333-eeae-4c1b-8323-6aed860f7601 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1655 microversion: 2.1 time: 0.253158 Jul 12 14:43:51.127193 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 273/549] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:50 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1655 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:51.142997 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-c40493a1-a800-4c07-b639-c70b7a200ed4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:43:51.148989 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c40493a1-a800-4c07-b639-c70b7a200ed4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:51.149504 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c40493a1-a800-4c07-b639-c70b7a200ed4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:51.171752 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-c40493a1-a800-4c07-b639-c70b7a200ed4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Going to try to start instance {{(pid=129980) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 12 14:43:51.233212 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-97eefbfa-de9d-4b87-ba57-953626dc82a5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Flavor limits 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:43:51.233635 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-97eefbfa-de9d-4b87-ba57-953626dc82a5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Image limits 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:43:51.241617 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-97eefbfa-de9d-4b87-ba57-953626dc82a5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Flavor pref 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:43:51.241617 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-97eefbfa-de9d-4b87-ba57-953626dc82a5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Image pref 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:43:51.241617 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-97eefbfa-de9d-4b87-ba57-953626dc82a5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:43:51.244177 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-97eefbfa-de9d-4b87-ba57-953626dc82a5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:51.244623 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-97eefbfa-de9d-4b87-ba57-953626dc82a5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:51.245454 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-97eefbfa-de9d-4b87-ba57-953626dc82a5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:51.245888 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-97eefbfa-de9d-4b87-ba57-953626dc82a5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:51.263146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.quota [None req-97eefbfa-de9d-4b87-ba57-953626dc82a5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Getting quotas for project c361a671e3fc43c8a536f6526dc530b1. Resources: {'instances', 'cores', 'ram'} {{(pid=129981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:43:51.267117 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.quota [None req-97eefbfa-de9d-4b87-ba57-953626dc82a5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Getting quotas for user 917bfc7c68384536a6945af83308f789 and project c361a671e3fc43c8a536f6526dc530b1. Resources: {'instances', 'cores', 'ram'} {{(pid=129981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:43:51.329757 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-97eefbfa-de9d-4b87-ba57-953626dc82a5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Going to run 1 instances... {{(pid=129981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:43:51.331872 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-97eefbfa-de9d-4b87-ba57-953626dc82a5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='93dd7901-5dd0-4397-bc70-7a4faa8ad307',volume_size=None,volume_type=None)] {{(pid=129981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:43:51.370615 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-c40493a1-a800-4c07-b639-c70b7a200ed4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "POST /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560/action" status: 202 len: 0 microversion: 2.1 time: 0.231538 Jul 12 14:43:51.373428 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 274/550] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Jul 12 14:43:51 2022] POST /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 14:43:51.378005 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-dba266d4-14fd-4a72-af98-06ab0fe110f0 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:51.378922 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-dba266d4-14fd-4a72-af98-06ab0fe110f0 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:51.385580 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-dba266d4-14fd-4a72-af98-06ab0fe110f0 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:51.386061 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-dba266d4-14fd-4a72-af98-06ab0fe110f0 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:51.386837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-dba266d4-14fd-4a72-af98-06ab0fe110f0 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:51.387279 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-dba266d4-14fd-4a72-af98-06ab0fe110f0 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:51.519932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-dba266d4-14fd-4a72-af98-06ab0fe110f0 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:51.528083 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-dba266d4-14fd-4a72-af98-06ab0fe110f0 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1735 microversion: 2.1 time: 0.155330 Jul 12 14:43:51.528639 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 275/551] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:51 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:51.533626 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-1dc8406a-89ff-434f-9438-2fb1128af2b3 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:51.534226 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-1dc8406a-89ff-434f-9438-2fb1128af2b3 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:51.539826 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1dc8406a-89ff-434f-9438-2fb1128af2b3 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:51.540270 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1dc8406a-89ff-434f-9438-2fb1128af2b3 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:51.542001 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1dc8406a-89ff-434f-9438-2fb1128af2b3 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:51.542467 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1dc8406a-89ff-434f-9438-2fb1128af2b3 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:51.746650 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-97eefbfa-de9d-4b87-ba57-953626dc82a5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.159734 Jul 12 14:43:51.748245 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 277/552] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Jul 12 14:43:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:43:51.758268 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-2a8dd8c9-3201-49bb-8db5-22ca9b87242e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:51.759446 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-2a8dd8c9-3201-49bb-8db5-22ca9b87242e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:51.771646 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-1dc8406a-89ff-434f-9438-2fb1128af2b3 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:51.790013 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-1dc8406a-89ff-434f-9438-2fb1128af2b3 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1664 microversion: 2.1 time: 0.260335 Jul 12 14:43:51.790609 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 276/553] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:51 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1664 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:51.872225 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-2a8dd8c9-3201-49bb-8db5-22ca9b87242e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:51.879008 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-2a8dd8c9-3201-49bb-8db5-22ca9b87242e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1094 microversion: 2.1 time: 0.124682 Jul 12 14:43:51.879850 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 278/554] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:51 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1094 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:51.888832 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-c7bf5815-4031-4948-b757-a1df9fca521c tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:51.889518 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-c7bf5815-4031-4948-b757-a1df9fca521c tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: 10a574c3-5f25-48a6-99e9-464bf90937a9] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:51.896049 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c7bf5815-4031-4948-b757-a1df9fca521c tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:51.896507 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c7bf5815-4031-4948-b757-a1df9fca521c tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:51.897317 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c7bf5815-4031-4948-b757-a1df9fca521c tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:51.897755 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c7bf5815-4031-4948-b757-a1df9fca521c tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:52.095465 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-c7bf5815-4031-4948-b757-a1df9fca521c tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:52.102965 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-c7bf5815-4031-4948-b757-a1df9fca521c tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9" status: 200 len: 1313 microversion: 2.1 time: 0.217793 Jul 12 14:43:52.103626 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 277/555] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:51 2022] GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:52.545836 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-5aa7c63e-c36d-4d2d-a8f2-5f47a05ca837 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:52.551643 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-5aa7c63e-c36d-4d2d-a8f2-5f47a05ca837 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:52.554245 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5aa7c63e-c36d-4d2d-a8f2-5f47a05ca837 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:52.554703 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5aa7c63e-c36d-4d2d-a8f2-5f47a05ca837 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:52.555529 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5aa7c63e-c36d-4d2d-a8f2-5f47a05ca837 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:52.555918 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5aa7c63e-c36d-4d2d-a8f2-5f47a05ca837 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:52.688886 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-5aa7c63e-c36d-4d2d-a8f2-5f47a05ca837 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:52.696984 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-5aa7c63e-c36d-4d2d-a8f2-5f47a05ca837 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1735 microversion: 2.1 time: 0.155020 Jul 12 14:43:52.697579 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 279/556] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:52 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:52.807775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-71042fbe-1674-4337-8bc7-9eac0b7fae57 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:52.808317 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-71042fbe-1674-4337-8bc7-9eac0b7fae57 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:52.810916 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell0:SELECT=2 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:52.818181 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-71042fbe-1674-4337-8bc7-9eac0b7fae57 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:52.818632 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-71042fbe-1674-4337-8bc7-9eac0b7fae57 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:52.819410 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-71042fbe-1674-4337-8bc7-9eac0b7fae57 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:52.819845 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-71042fbe-1674-4337-8bc7-9eac0b7fae57 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:52.896006 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-678c1672-600b-4f90-b506-ab698efd2b15 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:52.896610 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-678c1672-600b-4f90-b506-ab698efd2b15 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:52.903040 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-678c1672-600b-4f90-b506-ab698efd2b15 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:52.903489 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-678c1672-600b-4f90-b506-ab698efd2b15 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:52.904254 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-678c1672-600b-4f90-b506-ab698efd2b15 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:52.904686 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-678c1672-600b-4f90-b506-ab698efd2b15 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:52.976824 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-678c1672-600b-4f90-b506-ab698efd2b15 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:52.980751 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-71042fbe-1674-4337-8bc7-9eac0b7fae57 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:52.985392 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-678c1672-600b-4f90-b506-ab698efd2b15 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1144 microversion: 2.1 time: 0.092713 Jul 12 14:43:52.986219 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 280/557] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:52 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1144 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:52.989867 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-71042fbe-1674-4337-8bc7-9eac0b7fae57 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1664 microversion: 2.1 time: 0.186096 Jul 12 14:43:52.993934 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 278/558] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:52 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1664 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:53.088390 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-5c8724e8-9b80-4486-a8f7-e42630816c9d req-4a02f303-d305-447e-80b0-4faa0a0cd930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10a574c3-5f25-48a6-99e9-464bf90937a9", "name": "network-vif-plugged", "status": "completed", "tag": "a9b41b76-40cb-4f1e-b372-47ead7214e4f"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:43:53.097755 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-5c8724e8-9b80-4486-a8f7-e42630816c9d req-4a02f303-d305-447e-80b0-4faa0a0cd930 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:53.101886 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-5c8724e8-9b80-4486-a8f7-e42630816c9d req-4a02f303-d305-447e-80b0-4faa0a0cd930 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:53.109393 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-5c8724e8-9b80-4486-a8f7-e42630816c9d req-4a02f303-d305-447e-80b0-4faa0a0cd930 service nova] Creating event network-vif-plugged:a9b41b76-40cb-4f1e-b372-47ead7214e4f for instance 10a574c3-5f25-48a6-99e9-464bf90937a9 on hv-cinder-82002 Jul 12 14:43:53.115366 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-5c8724e8-9b80-4486-a8f7-e42630816c9d req-4a02f303-d305-447e-80b0-4faa0a0cd930 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030574 Jul 12 14:43:53.116022 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 281/559] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:43:53.119801 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-5a621717-f0df-4047-b1e5-f9fa5ed61d88 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:53.120410 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-5a621717-f0df-4047-b1e5-f9fa5ed61d88 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: 10a574c3-5f25-48a6-99e9-464bf90937a9] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:53.126682 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5a621717-f0df-4047-b1e5-f9fa5ed61d88 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:53.127129 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5a621717-f0df-4047-b1e5-f9fa5ed61d88 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:53.127879 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5a621717-f0df-4047-b1e5-f9fa5ed61d88 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:53.128322 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5a621717-f0df-4047-b1e5-f9fa5ed61d88 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:53.260028 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-5a621717-f0df-4047-b1e5-f9fa5ed61d88 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:53.268028 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-5a621717-f0df-4047-b1e5-f9fa5ed61d88 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9" status: 200 len: 1313 microversion: 2.1 time: 0.152023 Jul 12 14:43:53.269467 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 279/560] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:53 2022] GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:53.715313 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c4610e96-9635-4450-850d-95fd1de747cd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:53.716198 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-c4610e96-9635-4450-850d-95fd1de747cd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:53.724240 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c4610e96-9635-4450-850d-95fd1de747cd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:53.724889 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c4610e96-9635-4450-850d-95fd1de747cd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:53.725755 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c4610e96-9635-4450-850d-95fd1de747cd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:53.726437 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c4610e96-9635-4450-850d-95fd1de747cd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:53.865860 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c4610e96-9635-4450-850d-95fd1de747cd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:53.877140 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-c4610e96-9635-4450-850d-95fd1de747cd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1735 microversion: 2.1 time: 0.163769 Jul 12 14:43:53.877140 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 282/561] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:53 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:54.003203 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-899147dc-dd6a-4e61-97fc-888d6b53c639 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:54.003778 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-899147dc-dd6a-4e61-97fc-888d6b53c639 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:54.009615 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-4c9446a1-2b45-4ed5-857d-4465f258be8a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:54.010423 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-4c9446a1-2b45-4ed5-857d-4465f258be8a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:54.010533 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-899147dc-dd6a-4e61-97fc-888d6b53c639 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:54.010927 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-899147dc-dd6a-4e61-97fc-888d6b53c639 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:54.011735 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-899147dc-dd6a-4e61-97fc-888d6b53c639 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:54.012183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-899147dc-dd6a-4e61-97fc-888d6b53c639 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:54.016444 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4c9446a1-2b45-4ed5-857d-4465f258be8a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:54.016940 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4c9446a1-2b45-4ed5-857d-4465f258be8a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:54.017741 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4c9446a1-2b45-4ed5-857d-4465f258be8a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:54.018173 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4c9446a1-2b45-4ed5-857d-4465f258be8a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:54.084005 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-899147dc-dd6a-4e61-97fc-888d6b53c639 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:54.091446 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-899147dc-dd6a-4e61-97fc-888d6b53c639 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1136 microversion: 2.1 time: 0.093057 Jul 12 14:43:54.092042 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 280/562] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:53 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1136 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:54.167997 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-4c9446a1-2b45-4ed5-857d-4465f258be8a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:54.176075 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-4c9446a1-2b45-4ed5-857d-4465f258be8a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1668 microversion: 2.1 time: 0.171434 Jul 12 14:43:54.176641 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 283/563] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:54 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1668 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:54.284425 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-b3f4e7be-a998-439b-b56c-7862a47df1f2 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:54.285050 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-b3f4e7be-a998-439b-b56c-7862a47df1f2 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: 10a574c3-5f25-48a6-99e9-464bf90937a9] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:54.291170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b3f4e7be-a998-439b-b56c-7862a47df1f2 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:54.291617 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b3f4e7be-a998-439b-b56c-7862a47df1f2 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:54.292392 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b3f4e7be-a998-439b-b56c-7862a47df1f2 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:54.292819 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b3f4e7be-a998-439b-b56c-7862a47df1f2 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:54.419540 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-b3f4e7be-a998-439b-b56c-7862a47df1f2 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:54.427599 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-b3f4e7be-a998-439b-b56c-7862a47df1f2 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9" status: 200 len: 1313 microversion: 2.1 time: 0.147682 Jul 12 14:43:54.428168 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 281/564] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:54 2022] GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:54.894373 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-0f9de770-3bf0-44fe-9629-862fd6839db2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:54.894975 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-0f9de770-3bf0-44fe-9629-862fd6839db2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:54.901701 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0f9de770-3bf0-44fe-9629-862fd6839db2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:54.902151 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0f9de770-3bf0-44fe-9629-862fd6839db2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:54.902915 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0f9de770-3bf0-44fe-9629-862fd6839db2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:54.903342 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0f9de770-3bf0-44fe-9629-862fd6839db2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:55.035243 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-0f9de770-3bf0-44fe-9629-862fd6839db2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:55.043319 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-0f9de770-3bf0-44fe-9629-862fd6839db2 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1735 microversion: 2.1 time: 0.155788 Jul 12 14:43:55.043877 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 284/565] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:54 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:55.109692 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-dc295fe1-bd18-4802-a9c2-fe3fdf0e89a8 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:55.113132 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-dc295fe1-bd18-4802-a9c2-fe3fdf0e89a8 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:55.120056 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-dc295fe1-bd18-4802-a9c2-fe3fdf0e89a8 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:55.120498 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-dc295fe1-bd18-4802-a9c2-fe3fdf0e89a8 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:55.121446 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-dc295fe1-bd18-4802-a9c2-fe3fdf0e89a8 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:55.122116 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-dc295fe1-bd18-4802-a9c2-fe3fdf0e89a8 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:55.189288 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-dc295fe1-bd18-4802-a9c2-fe3fdf0e89a8 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:55.197179 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-dc295fe1-bd18-4802-a9c2-fe3fdf0e89a8 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1136 microversion: 2.1 time: 0.090607 Jul 12 14:43:55.197808 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 282/566] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:55 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1136 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:55.444961 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-1ca40265-8204-4af7-8a17-3f080c6d50eb tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:55.445095 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-1ca40265-8204-4af7-8a17-3f080c6d50eb tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: 10a574c3-5f25-48a6-99e9-464bf90937a9] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:55.451240 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1ca40265-8204-4af7-8a17-3f080c6d50eb tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:55.453676 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1ca40265-8204-4af7-8a17-3f080c6d50eb tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:55.453676 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1ca40265-8204-4af7-8a17-3f080c6d50eb tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:55.453676 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1ca40265-8204-4af7-8a17-3f080c6d50eb tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:55.583332 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-1ca40265-8204-4af7-8a17-3f080c6d50eb tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:55.590683 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-1ca40265-8204-4af7-8a17-3f080c6d50eb tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9" status: 200 len: 1313 microversion: 2.1 time: 0.150054 Jul 12 14:43:55.591255 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 285/567] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:55 2022] GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:56.060910 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-520eefc6-43c7-4fc1-a27b-1fdef5d1435e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:56.061479 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-520eefc6-43c7-4fc1-a27b-1fdef5d1435e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:56.068065 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-520eefc6-43c7-4fc1-a27b-1fdef5d1435e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:56.068508 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-520eefc6-43c7-4fc1-a27b-1fdef5d1435e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:56.069296 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-520eefc6-43c7-4fc1-a27b-1fdef5d1435e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:56.069728 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-520eefc6-43c7-4fc1-a27b-1fdef5d1435e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:56.197457 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-520eefc6-43c7-4fc1-a27b-1fdef5d1435e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:56.205413 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-520eefc6-43c7-4fc1-a27b-1fdef5d1435e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1735 microversion: 2.1 time: 0.148324 Jul 12 14:43:56.205976 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 283/568] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:56 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:56.213702 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-b40a41c2-b910-478b-9701-bb73f012604e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:56.214311 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-b40a41c2-b910-478b-9701-bb73f012604e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:56.220786 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b40a41c2-b910-478b-9701-bb73f012604e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:56.221277 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b40a41c2-b910-478b-9701-bb73f012604e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:56.222047 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b40a41c2-b910-478b-9701-bb73f012604e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:56.222506 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b40a41c2-b910-478b-9701-bb73f012604e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:56.285896 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-b40a41c2-b910-478b-9701-bb73f012604e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:56.293528 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-b40a41c2-b910-478b-9701-bb73f012604e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1192 microversion: 2.1 time: 0.083564 Jul 12 14:43:56.294110 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 286/569] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:56 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:56.607265 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-5423833b-d06f-4bbd-8f53-ad016b41b3b9 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:56.607873 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-5423833b-d06f-4bbd-8f53-ad016b41b3b9 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: 10a574c3-5f25-48a6-99e9-464bf90937a9] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:56.614472 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5423833b-d06f-4bbd-8f53-ad016b41b3b9 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:56.614916 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5423833b-d06f-4bbd-8f53-ad016b41b3b9 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:56.615664 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5423833b-d06f-4bbd-8f53-ad016b41b3b9 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:56.616095 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5423833b-d06f-4bbd-8f53-ad016b41b3b9 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:56.743582 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-5423833b-d06f-4bbd-8f53-ad016b41b3b9 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:56.751268 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-5423833b-d06f-4bbd-8f53-ad016b41b3b9 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9" status: 200 len: 1313 microversion: 2.1 time: 0.147856 Jul 12 14:43:56.751823 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 284/570] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:56 2022] GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:57.221765 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e1e55515-81a9-4a10-b55c-845581a1a843 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:57.222378 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-e1e55515-81a9-4a10-b55c-845581a1a843 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:57.229011 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e1e55515-81a9-4a10-b55c-845581a1a843 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:57.229497 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e1e55515-81a9-4a10-b55c-845581a1a843 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:57.230267 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e1e55515-81a9-4a10-b55c-845581a1a843 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:57.230708 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e1e55515-81a9-4a10-b55c-845581a1a843 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:57.310697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-b91fe797-dc0d-4c11-8607-fecb92eeb762 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:57.311306 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-b91fe797-dc0d-4c11-8607-fecb92eeb762 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:57.317749 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b91fe797-dc0d-4c11-8607-fecb92eeb762 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:57.318252 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b91fe797-dc0d-4c11-8607-fecb92eeb762 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:57.318953 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b91fe797-dc0d-4c11-8607-fecb92eeb762 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:57.319508 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b91fe797-dc0d-4c11-8607-fecb92eeb762 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:57.368704 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e1e55515-81a9-4a10-b55c-845581a1a843 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:57.377442 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-e1e55515-81a9-4a10-b55c-845581a1a843 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1735 microversion: 2.1 time: 0.159482 Jul 12 14:43:57.378024 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 287/571] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:57 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:57.387698 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-b91fe797-dc0d-4c11-8607-fecb92eeb762 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:57.395129 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-b91fe797-dc0d-4c11-8607-fecb92eeb762 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1192 microversion: 2.1 time: 0.088228 Jul 12 14:43:57.395754 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 285/572] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:57 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1192 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:57.768330 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-8e7061bd-5529-43c1-a5c2-031e356c1744 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:57.768956 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-8e7061bd-5529-43c1-a5c2-031e356c1744 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: 10a574c3-5f25-48a6-99e9-464bf90937a9] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:57.775048 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8e7061bd-5529-43c1-a5c2-031e356c1744 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:57.775510 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8e7061bd-5529-43c1-a5c2-031e356c1744 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:57.776273 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8e7061bd-5529-43c1-a5c2-031e356c1744 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:57.776734 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8e7061bd-5529-43c1-a5c2-031e356c1744 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:57.903038 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-8e7061bd-5529-43c1-a5c2-031e356c1744 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:57.911290 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-8e7061bd-5529-43c1-a5c2-031e356c1744 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9" status: 200 len: 1497 microversion: 2.1 time: 0.147351 Jul 12 14:43:57.911857 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 288/573] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:57 2022] GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9 => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:58.395144 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-80b7507d-f681-4cdd-ae9d-7f5175ea34b9 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:58.395894 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-80b7507d-f681-4cdd-ae9d-7f5175ea34b9 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:58.402614 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-80b7507d-f681-4cdd-ae9d-7f5175ea34b9 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:58.403061 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-80b7507d-f681-4cdd-ae9d-7f5175ea34b9 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:58.403815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-80b7507d-f681-4cdd-ae9d-7f5175ea34b9 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:58.404246 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-80b7507d-f681-4cdd-ae9d-7f5175ea34b9 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:58.412697 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c22a08e5-ac6c-4585-9937-6c7602302fec tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:58.413733 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-c22a08e5-ac6c-4585-9937-6c7602302fec tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:58.420290 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c22a08e5-ac6c-4585-9937-6c7602302fec tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:58.420738 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c22a08e5-ac6c-4585-9937-6c7602302fec tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:58.421548 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c22a08e5-ac6c-4585-9937-6c7602302fec tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:58.421984 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c22a08e5-ac6c-4585-9937-6c7602302fec tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:58.514171 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c22a08e5-ac6c-4585-9937-6c7602302fec tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:58.522372 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-c22a08e5-ac6c-4585-9937-6c7602302fec tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1200 microversion: 2.1 time: 0.113789 Jul 12 14:43:58.523083 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 289/574] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:58 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1200 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:58.572154 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-80b7507d-f681-4cdd-ae9d-7f5175ea34b9 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:58.580653 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-80b7507d-f681-4cdd-ae9d-7f5175ea34b9 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1715 microversion: 2.1 time: 0.189827 Jul 12 14:43:58.581357 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 286/575] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:58 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1715 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:58.685780 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-006b4721-1930-4c3b-a464-bc3a57e63781 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:58.686352 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-006b4721-1930-4c3b-a464-bc3a57e63781 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:58.688370 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:58.693252 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-006b4721-1930-4c3b-a464-bc3a57e63781 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:58.697870 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-006b4721-1930-4c3b-a464-bc3a57e63781 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:58.697870 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-006b4721-1930-4c3b-a464-bc3a57e63781 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:58.697870 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-006b4721-1930-4c3b-a464-bc3a57e63781 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:58.774989 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.wsgi [None req-006b4721-1930-4c3b-a464-bc3a57e63781 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] HTTP exception thrown: Cannot 'detach_volume' instance 8a9deddf-4864-4ad7-9f64-51b96f7c45eb while it is in vm_state rescued Jul 12 14:43:58.776603 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-006b4721-1930-4c3b-a464-bc3a57e63781 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Request method failure captured: Jul 12 14:43:58.776603 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: DELETE /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb/os-volume_attachments/68b1884c-54d0-412f-8946-a28baead197e HTTP/1.1 Jul 12 14:43:58.776603 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:43:58.776603 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:43:58.776603 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:43:58.776603 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 0 Jul 12 14:43:58.776603 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:43:58.776603 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:43:58.776603 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:43:58.776603 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:43:58.776603 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYehYws4HrgGrv1QXrmsu2xWw8GXYW-BydE4l3b7e715YjEfH2g10AAcubc3F8Fua7xKtXboov3Y2Z32aGrkzrkDds152RTIhjLssnjoz683AGXZ-ffmMw8OOKRJ4-u7WEcb8UqTTsJ21R318wN3uwczHyiupKx-Uh53TY_6T4OsmzU Jul 12 14:43:58.776603 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:43:58.776603 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:43:58.776603 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:43:58.776603 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:43:58.776603 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:43:58.776603 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:43:58.776603 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: fe2b01873d92453599763e5523a862f8 Jul 12 14:43:58.776603 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-241601666 Jul 12 14:43:58.776603 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:43:58.776603 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:43:58.777994 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fe2b01873d92453599763e5523a862f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fe2b01873d92453599763e5523a862f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fe2b01873d92453599763e5523a862f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fe2b01873d92453599763e5523a862f8", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:43:58.777994 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-ServerRescueNegativeTestJSON-241601666 Jul 12 14:43:58.777994 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: fe2b01873d92453599763e5523a862f8 Jul 12 14:43:58.777994 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-241601666 Jul 12 14:43:58.777994 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-ServerRescueNegativeTestJSON-241601666-project Jul 12 14:43:58.777994 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:43:58.777994 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:43:58.777994 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: 97f1b1e52a984639a504441e3701b981 Jul 12 14:43:58.777994 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-ServerRescueNegativeTestJSON-241601666-project Jul 12 14:43:58.777994 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: > Jul 12 14:43:58.777994 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Cannot 'detach_volume' instance 8a9deddf-4864-4ad7-9f64-51b96f7c45eb while it is in vm_state rescued Jul 12 14:43:58.778661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'server_id': '8a9deddf-4864-4ad7-9f64-51b96f7c45eb', 'id': '68b1884c-54d0-412f-8946-a28baead197e'} Jul 12 14:43:58.778661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:43:58.778661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:43:58.778661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 12 14:43:58.778661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 12 14:43:58.778661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 14:43:58.778661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 14:43:58.778661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 12 14:43:58.778661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 14:43:58.778661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8a9deddf-4864-4ad7-9f64-51b96f7c45eb in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 12 14:43:58.778661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:43:58.778661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:43:58.778661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:43:58.778661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:43:58.778661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:43:58.778661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:43:58.778661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:43:58.778661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:43:58.778661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:43:58.778661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:43:58.780298 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 12 14:43:58.780298 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 14:43:58.780298 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 14:43:58.780298 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 14:43:58.780298 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8a9deddf-4864-4ad7-9f64-51b96f7c45eb while it is in vm_state rescued Jul 12 14:43:58.780298 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:43:58.780298 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:43:58.780298 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:43:58.780298 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:43:58.780298 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:43:58.780298 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:43:58.780298 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:43:58.780298 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:43:58.780298 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8a9deddf-4864-4ad7-9f64-51b96f7c45eb while it is in vm_state rescued Jul 12 14:43:58.780298 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:43:58.780298 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-006b4721-1930-4c3b-a464-bc3a57e63781 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Returning 409 to user: Cannot 'detach_volume' instance 8a9deddf-4864-4ad7-9f64-51b96f7c45eb while it is in vm_state rescued {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:43:58.781376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-006b4721-1930-4c3b-a464-bc3a57e63781 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb/os-volume_attachments/68b1884c-54d0-412f-8946-a28baead197e" status: 409 len: 152 microversion: 2.1 time: 0.096394 Jul 12 14:43:58.781376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 290/576] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Jul 12 14:43:58 2022] DELETE /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb/os-volume_attachments/68b1884c-54d0-412f-8946-a28baead197e => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 12 14:43:58.786901 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-44e72afd-9fd4-4ea5-9f64-316af0cbe0cf tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:43:58.787437 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-44e72afd-9fd4-4ea5-9f64-316af0cbe0cf tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:58.793510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-44e72afd-9fd4-4ea5-9f64-316af0cbe0cf tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:58.793962 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-44e72afd-9fd4-4ea5-9f64-316af0cbe0cf tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:58.794719 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-44e72afd-9fd4-4ea5-9f64-316af0cbe0cf tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:58.795158 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-44e72afd-9fd4-4ea5-9f64-316af0cbe0cf tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:58.926957 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-ceaa914a-d643-4d56-b9d2-7b534d86795c tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:58.927397 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-ceaa914a-d643-4d56-b9d2-7b534d86795c tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: 10a574c3-5f25-48a6-99e9-464bf90937a9] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:58.933604 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ceaa914a-d643-4d56-b9d2-7b534d86795c tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:58.934080 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ceaa914a-d643-4d56-b9d2-7b534d86795c tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:58.934834 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ceaa914a-d643-4d56-b9d2-7b534d86795c tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:58.935265 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ceaa914a-d643-4d56-b9d2-7b534d86795c tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:58.960881 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-ceaa914a-d643-4d56-b9d2-7b534d86795c tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: 10a574c3-5f25-48a6-99e9-464bf90937a9] Going to try to terminate instance {{(pid=129981) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:43:58.965656 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-44e72afd-9fd4-4ea5-9f64-316af0cbe0cf tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "POST /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb/action" status: 202 len: 0 microversion: 2.1 time: 0.182266 Jul 12 14:43:58.966435 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 287/577] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Jul 12 14:43:58 2022] POST /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:43:58.974627 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ad0139c8-95aa-4dac-8c45-1c6d7760f1fe tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:58.975447 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-ad0139c8-95aa-4dac-8c45-1c6d7760f1fe tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:58.977568 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:58.982672 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ad0139c8-95aa-4dac-8c45-1c6d7760f1fe tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:58.983127 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ad0139c8-95aa-4dac-8c45-1c6d7760f1fe tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:58.983996 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ad0139c8-95aa-4dac-8c45-1c6d7760f1fe tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:58.984438 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ad0139c8-95aa-4dac-8c45-1c6d7760f1fe tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:58.988570 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:59.116476 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ad0139c8-95aa-4dac-8c45-1c6d7760f1fe tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:59.124816 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ad0139c8-95aa-4dac-8c45-1c6d7760f1fe tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1723 microversion: 2.1 time: 0.154163 Jul 12 14:43:59.125500 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 288/578] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:58 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:59.236485 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-ceaa914a-d643-4d56-b9d2-7b534d86795c tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "DELETE /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9" status: 204 len: 0 microversion: 2.1 time: 0.313456 Jul 12 14:43:59.237070 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 291/579] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Jul 12 14:43:58 2022] DELETE /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 14:43:59.245835 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-1492975e-4917-40df-b4ee-91b01925d2f7 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:59.246442 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-1492975e-4917-40df-b4ee-91b01925d2f7 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: 10a574c3-5f25-48a6-99e9-464bf90937a9] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:59.253771 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1492975e-4917-40df-b4ee-91b01925d2f7 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:59.254213 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1492975e-4917-40df-b4ee-91b01925d2f7 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:59.255080 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1492975e-4917-40df-b4ee-91b01925d2f7 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:59.255516 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1492975e-4917-40df-b4ee-91b01925d2f7 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:59.384301 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-1492975e-4917-40df-b4ee-91b01925d2f7 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:59.392056 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-1492975e-4917-40df-b4ee-91b01925d2f7 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9" status: 200 len: 1503 microversion: 2.1 time: 0.150824 Jul 12 14:43:59.392650 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 289/580] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:59 2022] GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:59.540799 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-2c13724d-af88-4ea0-804c-9cd20884d9d5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:59.541611 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-2c13724d-af88-4ea0-804c-9cd20884d9d5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:59.548196 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2c13724d-af88-4ea0-804c-9cd20884d9d5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:59.548651 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2c13724d-af88-4ea0-804c-9cd20884d9d5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:59.549532 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2c13724d-af88-4ea0-804c-9cd20884d9d5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:59.550578 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2c13724d-af88-4ea0-804c-9cd20884d9d5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:59.613507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-2c13724d-af88-4ea0-804c-9cd20884d9d5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:59.621386 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-2c13724d-af88-4ea0-804c-9cd20884d9d5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1200 microversion: 2.1 time: 0.085384 Jul 12 14:43:59.621953 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 292/581] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:59 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1200 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:44:00.143129 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-667f0407-f9c7-4125-ad92-53835b05522b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:00.143790 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-667f0407-f9c7-4125-ad92-53835b05522b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:00.150736 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-667f0407-f9c7-4125-ad92-53835b05522b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:00.151183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-667f0407-f9c7-4125-ad92-53835b05522b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:00.151941 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-667f0407-f9c7-4125-ad92-53835b05522b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:00.152372 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-667f0407-f9c7-4125-ad92-53835b05522b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:00.279476 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-667f0407-f9c7-4125-ad92-53835b05522b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:00.287404 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-667f0407-f9c7-4125-ad92-53835b05522b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1723 microversion: 2.1 time: 0.148657 Jul 12 14:44:00.287975 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 290/582] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:00 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:00.409186 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-f54393bb-11e5-4041-9021-9fce939630ba tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:00.409741 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-f54393bb-11e5-4041-9021-9fce939630ba tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: 10a574c3-5f25-48a6-99e9-464bf90937a9] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:00.415685 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f54393bb-11e5-4041-9021-9fce939630ba tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:00.416126 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f54393bb-11e5-4041-9021-9fce939630ba tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:00.416961 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f54393bb-11e5-4041-9021-9fce939630ba tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:00.417419 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f54393bb-11e5-4041-9021-9fce939630ba tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:00.545799 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-f54393bb-11e5-4041-9021-9fce939630ba tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:00.553569 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-f54393bb-11e5-4041-9021-9fce939630ba tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9" status: 200 len: 1503 microversion: 2.1 time: 0.148205 Jul 12 14:44:00.554126 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 293/583] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:00 2022] GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:00.637826 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ca892ed6-50fa-4e47-a44d-04446137017d tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:00.638435 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-ca892ed6-50fa-4e47-a44d-04446137017d tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:00.645035 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ca892ed6-50fa-4e47-a44d-04446137017d tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:00.645517 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ca892ed6-50fa-4e47-a44d-04446137017d tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:00.646275 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ca892ed6-50fa-4e47-a44d-04446137017d tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:00.646716 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ca892ed6-50fa-4e47-a44d-04446137017d tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:00.709130 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ca892ed6-50fa-4e47-a44d-04446137017d tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:00.716551 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ca892ed6-50fa-4e47-a44d-04446137017d tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1210 microversion: 2.1 time: 0.082590 Jul 12 14:44:00.717110 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 291/584] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:00 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:01.304307 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-a949f257-803c-46ea-b40a-a96ec05ca8a7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:01.304914 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-a949f257-803c-46ea-b40a-a96ec05ca8a7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:01.306932 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell0:SELECT=4 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:01.311780 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a949f257-803c-46ea-b40a-a96ec05ca8a7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:01.312228 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a949f257-803c-46ea-b40a-a96ec05ca8a7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:01.312988 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a949f257-803c-46ea-b40a-a96ec05ca8a7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:01.313448 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a949f257-803c-46ea-b40a-a96ec05ca8a7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:01.317326 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:01.514276 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-a949f257-803c-46ea-b40a-a96ec05ca8a7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:01.522654 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-a949f257-803c-46ea-b40a-a96ec05ca8a7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1723 microversion: 2.1 time: 0.222176 Jul 12 14:44:01.523310 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 294/585] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:01 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:01.569828 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-bbded71e-0f79-4adb-8202-b2f9cd9d20a7 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:01.570432 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-bbded71e-0f79-4adb-8202-b2f9cd9d20a7 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: 10a574c3-5f25-48a6-99e9-464bf90937a9] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:01.577330 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bbded71e-0f79-4adb-8202-b2f9cd9d20a7 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:01.577972 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bbded71e-0f79-4adb-8202-b2f9cd9d20a7 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:01.579450 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bbded71e-0f79-4adb-8202-b2f9cd9d20a7 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:01.579883 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bbded71e-0f79-4adb-8202-b2f9cd9d20a7 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:01.734042 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-220bb2ab-3757-4aef-b54e-83ba0277ab8c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:01.734429 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-220bb2ab-3757-4aef-b54e-83ba0277ab8c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:01.741707 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-220bb2ab-3757-4aef-b54e-83ba0277ab8c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:01.742156 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-220bb2ab-3757-4aef-b54e-83ba0277ab8c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:01.742927 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-220bb2ab-3757-4aef-b54e-83ba0277ab8c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:01.743556 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-220bb2ab-3757-4aef-b54e-83ba0277ab8c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:01.761142 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-bbded71e-0f79-4adb-8202-b2f9cd9d20a7 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:01.769838 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-bbded71e-0f79-4adb-8202-b2f9cd9d20a7 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9" status: 200 len: 1503 microversion: 2.1 time: 0.203651 Jul 12 14:44:01.779774 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 292/586] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:01 2022] GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9 => generated 1503 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:01.814368 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-220bb2ab-3757-4aef-b54e-83ba0277ab8c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:01.822293 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-220bb2ab-3757-4aef-b54e-83ba0277ab8c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1210 microversion: 2.1 time: 0.092223 Jul 12 14:44:01.823004 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 295/587] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:01 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:44:02.540261 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-c6e5bbc3-2e26-4532-a0b7-2a1b45312be4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:02.540928 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-c6e5bbc3-2e26-4532-a0b7-2a1b45312be4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:02.541983 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-dcb48284-3cf1-43e6-8591-251e582c1b41 req-2e44e210-cec8-4135-8d39-061a566e8aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10a574c3-5f25-48a6-99e9-464bf90937a9", "name": "network-vif-deleted", "tag": "a9b41b76-40cb-4f1e-b372-47ead7214e4f"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:44:02.545660 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell0:SELECT=14 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:02.548688 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c6e5bbc3-2e26-4532-a0b7-2a1b45312be4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:02.549437 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c6e5bbc3-2e26-4532-a0b7-2a1b45312be4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:02.550416 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c6e5bbc3-2e26-4532-a0b7-2a1b45312be4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:02.551043 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c6e5bbc3-2e26-4532-a0b7-2a1b45312be4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:02.553105 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-dcb48284-3cf1-43e6-8591-251e582c1b41 req-2e44e210-cec8-4135-8d39-061a566e8aaf service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:02.553651 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-dcb48284-3cf1-43e6-8591-251e582c1b41 req-2e44e210-cec8-4135-8d39-061a566e8aaf service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:02.565960 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-dcb48284-3cf1-43e6-8591-251e582c1b41 req-2e44e210-cec8-4135-8d39-061a566e8aaf service nova] Creating event network-vif-deleted:a9b41b76-40cb-4f1e-b372-47ead7214e4f for instance 10a574c3-5f25-48a6-99e9-464bf90937a9 on hv-cinder-82002 Jul 12 14:44:02.571300 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-dcb48284-3cf1-43e6-8591-251e582c1b41 req-2e44e210-cec8-4135-8d39-061a566e8aaf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033598 Jul 12 14:44:02.576657 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 296/588] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:44:02.693466 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-c6e5bbc3-2e26-4532-a0b7-2a1b45312be4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:02.702179 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-c6e5bbc3-2e26-4532-a0b7-2a1b45312be4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1723 microversion: 2.1 time: 0.165964 Jul 12 14:44:02.703192 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 293/589] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:02 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:02.788568 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-945e13dc-224f-4377-b42f-a0a4f423144a tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:02.790982 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-945e13dc-224f-4377-b42f-a0a4f423144a tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: 10a574c3-5f25-48a6-99e9-464bf90937a9] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:02.797239 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-945e13dc-224f-4377-b42f-a0a4f423144a tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:02.798609 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-945e13dc-224f-4377-b42f-a0a4f423144a tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:02.799383 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-945e13dc-224f-4377-b42f-a0a4f423144a tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:02.799816 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-945e13dc-224f-4377-b42f-a0a4f423144a tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:02.840268 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-9f7c537c-acb9-4c0c-bce5-056cdacb8c24 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:02.840938 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-9f7c537c-acb9-4c0c-bce5-056cdacb8c24 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:02.848292 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9f7c537c-acb9-4c0c-bce5-056cdacb8c24 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:02.848968 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9f7c537c-acb9-4c0c-bce5-056cdacb8c24 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:02.850297 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9f7c537c-acb9-4c0c-bce5-056cdacb8c24 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:02.850744 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9f7c537c-acb9-4c0c-bce5-056cdacb8c24 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:02.867480 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-945e13dc-224f-4377-b42f-a0a4f423144a tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:02.875565 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-945e13dc-224f-4377-b42f-a0a4f423144a tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9" status: 200 len: 1461 microversion: 2.1 time: 0.091563 Jul 12 14:44:02.876352 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 297/590] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:02 2022] GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9 => generated 1461 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:02.984589 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-9f7c537c-acb9-4c0c-bce5-056cdacb8c24 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:02.992663 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-9f7c537c-acb9-4c0c-bce5-056cdacb8c24 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1278 microversion: 2.1 time: 0.156964 Jul 12 14:44:02.996960 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 294/591] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:02 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:44:03.021191 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-000a6749-c487-406a-be28-10f950a58828 req-769c5cb3-5aae-4183-a41b-da1633448056 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01cf8542-b5a1-4e34-a424-41d130ff60b6", "tag": "04f81fac-5835-4383-819e-c1a0c737643b"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:44:03.030155 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-000a6749-c487-406a-be28-10f950a58828 req-769c5cb3-5aae-4183-a41b-da1633448056 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:03.030836 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-000a6749-c487-406a-be28-10f950a58828 req-769c5cb3-5aae-4183-a41b-da1633448056 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:03.043202 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-000a6749-c487-406a-be28-10f950a58828 req-769c5cb3-5aae-4183-a41b-da1633448056 service nova] Creating event network-changed:04f81fac-5835-4383-819e-c1a0c737643b for instance 01cf8542-b5a1-4e34-a424-41d130ff60b6 on hv-cinder-82002 Jul 12 14:44:03.047956 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-000a6749-c487-406a-be28-10f950a58828 req-769c5cb3-5aae-4183-a41b-da1633448056 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031127 Jul 12 14:44:03.048545 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 298/592] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:44:03.720241 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-68a64beb-0ec7-4e44-88ac-d681fa839e39 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:03.720757 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-68a64beb-0ec7-4e44-88ac-d681fa839e39 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:03.727340 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-68a64beb-0ec7-4e44-88ac-d681fa839e39 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:03.727793 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-68a64beb-0ec7-4e44-88ac-d681fa839e39 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:03.728550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-68a64beb-0ec7-4e44-88ac-d681fa839e39 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:03.728988 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-68a64beb-0ec7-4e44-88ac-d681fa839e39 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:03.854188 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-68a64beb-0ec7-4e44-88ac-d681fa839e39 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:03.862390 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-68a64beb-0ec7-4e44-88ac-d681fa839e39 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1723 microversion: 2.1 time: 0.146691 Jul 12 14:44:03.862963 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 295/593] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:03 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:03.893173 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e2c7c0ac-7156-4111-96e1-0ee3cfff6a77 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:03.893909 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-e2c7c0ac-7156-4111-96e1-0ee3cfff6a77 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: 10a574c3-5f25-48a6-99e9-464bf90937a9] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:03.900071 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e2c7c0ac-7156-4111-96e1-0ee3cfff6a77 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:03.900542 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e2c7c0ac-7156-4111-96e1-0ee3cfff6a77 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:03.901334 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e2c7c0ac-7156-4111-96e1-0ee3cfff6a77 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:03.901768 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e2c7c0ac-7156-4111-96e1-0ee3cfff6a77 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:03.965709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e2c7c0ac-7156-4111-96e1-0ee3cfff6a77 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:03.973867 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-e2c7c0ac-7156-4111-96e1-0ee3cfff6a77 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9" status: 200 len: 1461 microversion: 2.1 time: 0.085822 Jul 12 14:44:03.974364 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 299/594] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:03 2022] GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9 => generated 1461 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:04.010514 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-f3599682-ff70-43a2-94dd-29673aa0d4f4 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:04.011148 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-f3599682-ff70-43a2-94dd-29673aa0d4f4 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:04.018024 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f3599682-ff70-43a2-94dd-29673aa0d4f4 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:04.018516 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f3599682-ff70-43a2-94dd-29673aa0d4f4 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:04.019285 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f3599682-ff70-43a2-94dd-29673aa0d4f4 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:04.019744 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f3599682-ff70-43a2-94dd-29673aa0d4f4 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:04.150334 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-f3599682-ff70-43a2-94dd-29673aa0d4f4 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:04.158160 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-f3599682-ff70-43a2-94dd-29673aa0d4f4 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1278 microversion: 2.1 time: 0.151353 Jul 12 14:44:04.158745 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 296/595] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:04 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:04.879553 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-b20d66e8-a730-4c2d-afe4-f61f3279b0f7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:04.880156 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-b20d66e8-a730-4c2d-afe4-f61f3279b0f7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:04.886271 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b20d66e8-a730-4c2d-afe4-f61f3279b0f7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:04.886714 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b20d66e8-a730-4c2d-afe4-f61f3279b0f7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:04.887464 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b20d66e8-a730-4c2d-afe4-f61f3279b0f7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:04.887895 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b20d66e8-a730-4c2d-afe4-f61f3279b0f7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:04.991747 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0502d4a8-4474-41d1-8063-7cd5fa6c09fd tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:04.992365 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-0502d4a8-4474-41d1-8063-7cd5fa6c09fd tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: 10a574c3-5f25-48a6-99e9-464bf90937a9] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:04.999231 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0502d4a8-4474-41d1-8063-7cd5fa6c09fd tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:04.999684 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0502d4a8-4474-41d1-8063-7cd5fa6c09fd tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:05.000441 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0502d4a8-4474-41d1-8063-7cd5fa6c09fd tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:05.001439 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0502d4a8-4474-41d1-8063-7cd5fa6c09fd tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:05.024775 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-b20d66e8-a730-4c2d-afe4-f61f3279b0f7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:05.029438 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-b20d66e8-a730-4c2d-afe4-f61f3279b0f7 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1729 microversion: 2.1 time: 0.153715 Jul 12 14:44:05.030015 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 300/596] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:04 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:05.032476 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0502d4a8-4474-41d1-8063-7cd5fa6c09fd tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:05.032918 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0502d4a8-4474-41d1-8063-7cd5fa6c09fd tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:05.033385 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.objects.instance [None req-0502d4a8-4474-41d1-8063-7cd5fa6c09fd tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lazy-loading 'fault' on Instance uuid 10a574c3-5f25-48a6-99e9-464bf90937a9 {{(pid=129980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:44:05.045738 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-20896393-d3dc-4a2b-9f01-ff0d04c29185 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:05.046314 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-20896393-d3dc-4a2b-9f01-ff0d04c29185 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:05.052838 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-20896393-d3dc-4a2b-9f01-ff0d04c29185 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:05.053410 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-20896393-d3dc-4a2b-9f01-ff0d04c29185 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:05.054268 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-20896393-d3dc-4a2b-9f01-ff0d04c29185 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:05.055070 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-20896393-d3dc-4a2b-9f01-ff0d04c29185 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:05.077285 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-0502d4a8-4474-41d1-8063-7cd5fa6c09fd tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:05.085392 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-0502d4a8-4474-41d1-8063-7cd5fa6c09fd tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9" status: 200 len: 1303 microversion: 2.1 time: 0.098355 Jul 12 14:44:05.085962 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 297/597] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:04 2022] GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9 => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:44:05.175763 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-6bbb43f2-e2c2-438c-9024-223211129bc3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:05.176466 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-6bbb43f2-e2c2-438c-9024-223211129bc3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:05.183027 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6bbb43f2-e2c2-438c-9024-223211129bc3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:05.183473 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6bbb43f2-e2c2-438c-9024-223211129bc3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:05.184243 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6bbb43f2-e2c2-438c-9024-223211129bc3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:05.184675 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6bbb43f2-e2c2-438c-9024-223211129bc3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:05.393996 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-20896393-d3dc-4a2b-9f01-ff0d04c29185 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.351979 Jul 12 14:44:05.395112 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 301/598] 10.222.0.30 () {58 vars in 1274 bytes} [Tue Jul 12 14:44:05 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb/os-interface => generated 284 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:44:05.471807 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-6bbb43f2-e2c2-438c-9024-223211129bc3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:05.471978 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-6bbb43f2-e2c2-438c-9024-223211129bc3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1278 microversion: 2.1 time: 0.300719 Jul 12 14:44:05.472448 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 298/599] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:05 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1278 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:44:06.103344 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-74ff6ff0-27bb-4767-84f1-de53a79bf275 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:06.103956 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-74ff6ff0-27bb-4767-84f1-de53a79bf275 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: 10a574c3-5f25-48a6-99e9-464bf90937a9] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:06.110264 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-74ff6ff0-27bb-4767-84f1-de53a79bf275 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:06.110854 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-74ff6ff0-27bb-4767-84f1-de53a79bf275 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:06.111627 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-74ff6ff0-27bb-4767-84f1-de53a79bf275 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:06.112069 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-74ff6ff0-27bb-4767-84f1-de53a79bf275 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:06.144981 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-74ff6ff0-27bb-4767-84f1-de53a79bf275 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:06.145451 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-74ff6ff0-27bb-4767-84f1-de53a79bf275 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:06.145893 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.objects.instance [None req-74ff6ff0-27bb-4767-84f1-de53a79bf275 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lazy-loading 'fault' on Instance uuid 10a574c3-5f25-48a6-99e9-464bf90937a9 {{(pid=129981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:44:06.200580 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-74ff6ff0-27bb-4767-84f1-de53a79bf275 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac06a23a9b84ec38e0712bad9046762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f15caa06dac4f2b952ff64f9e9e74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:06.209353 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-74ff6ff0-27bb-4767-84f1-de53a79bf275 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9" status: 200 len: 1303 microversion: 2.1 time: 0.111242 Jul 12 14:44:06.218732 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 302/600] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:06 2022] GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9 => generated 1303 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:06.487859 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ccde7c17-363a-4720-8318-7f56c047422c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:06.488570 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-ccde7c17-363a-4720-8318-7f56c047422c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:06.495277 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ccde7c17-363a-4720-8318-7f56c047422c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:06.495815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ccde7c17-363a-4720-8318-7f56c047422c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:06.496637 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ccde7c17-363a-4720-8318-7f56c047422c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:06.497073 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ccde7c17-363a-4720-8318-7f56c047422c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:06.629873 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ccde7c17-363a-4720-8318-7f56c047422c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:06.637403 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ccde7c17-363a-4720-8318-7f56c047422c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1266 microversion: 2.1 time: 0.153297 Jul 12 14:44:06.637905 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 299/601] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:06 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:07.031172 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-08e20a11-0614-4749-87c3-06580abf7f43 req-b25f6577-6ccc-44d7-b702-b898242f07f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a9deddf-4864-4ad7-9f64-51b96f7c45eb", "tag": "12bf018a-5099-450d-857c-a8150eca7139"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:44:07.040719 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-08e20a11-0614-4749-87c3-06580abf7f43 req-b25f6577-6ccc-44d7-b702-b898242f07f4 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:07.040914 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-08e20a11-0614-4749-87c3-06580abf7f43 req-b25f6577-6ccc-44d7-b702-b898242f07f4 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:07.057668 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-08e20a11-0614-4749-87c3-06580abf7f43 req-b25f6577-6ccc-44d7-b702-b898242f07f4 service nova] Creating event network-changed:12bf018a-5099-450d-857c-a8150eca7139 for instance 8a9deddf-4864-4ad7-9f64-51b96f7c45eb on hv-cinder-82002 Jul 12 14:44:07.061422 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-08e20a11-0614-4749-87c3-06580abf7f43 req-b25f6577-6ccc-44d7-b702-b898242f07f4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033998 Jul 12 14:44:07.062023 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 303/602] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:44:07.226681 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-096d98af-48b2-47e9-82c5-4d92f2d0ced6 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:07.227306 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-096d98af-48b2-47e9-82c5-4d92f2d0ced6 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] [instance: 10a574c3-5f25-48a6-99e9-464bf90937a9] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:07.233191 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-096d98af-48b2-47e9-82c5-4d92f2d0ced6 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:07.233652 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-096d98af-48b2-47e9-82c5-4d92f2d0ced6 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:07.234429 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-096d98af-48b2-47e9-82c5-4d92f2d0ced6 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:07.234871 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-096d98af-48b2-47e9-82c5-4d92f2d0ced6 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:07.250943 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.wsgi [None req-096d98af-48b2-47e9-82c5-4d92f2d0ced6 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] HTTP exception thrown: Instance 10a574c3-5f25-48a6-99e9-464bf90937a9 could not be found. Jul 12 14:44:07.252696 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-096d98af-48b2-47e9-82c5-4d92f2d0ced6 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Request method failure captured: Jul 12 14:44:07.252696 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: request: GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9 HTTP/1.1 Jul 12 14:44:07.252696 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept: application/json Jul 12 14:44:07.252696 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept-Encoding: identity Jul 12 14:44:07.252696 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Connection: close Jul 12 14:44:07.252696 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Length: 0 Jul 12 14:44:07.252696 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Type: application/json Jul 12 14:44:07.252696 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Host: 10.222.0.30 Jul 12 14:44:07.252696 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Openstack-System-Scope: None Jul 12 14:44:07.252696 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: User-Agent: python-urllib3/1.26.9 Jul 12 14:44:07.252696 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Auth-Token: gAAAAABizYiCLM_38mkmVin9r-oqk91B_IBaiKT60qR9z3S2VZ3cFFWWGvJD7q-ZR7IqXNK_rjqJFxDIEyTo9b4v0fIapNIB5T2wQwW6xmRojXTf3RVcI_Xu4nAlr2mK9Svkshk7VKdN3YIElHDEa9-a6k5hgAkTqyMcgEmRXXOX-1enQDxW2s0 Jul 12 14:44:07.252696 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Id: None Jul 12 14:44:07.252696 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Name: None Jul 12 14:44:07.252696 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Identity-Status: Confirmed Jul 12 14:44:07.252696 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Is-Admin-Project: True Jul 12 14:44:07.252696 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Id: default Jul 12 14:44:07.252696 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Name: Default Jul 12 14:44:07.252696 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Id: 1f15caa06dac4f2b952ff64f9e9e74ca Jul 12 14:44:07.252696 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Name: tempest-VolumesActionsTest-2122839514 Jul 12 14:44:07.252696 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Role: member,reader Jul 12 14:44:07.252696 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Roles: member,reader Jul 12 14:44:07.254379 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f15caa06dac4f2b952ff64f9e9e74ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1f15caa06dac4f2b952ff64f9e9e74ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f15caa06dac4f2b952ff64f9e9e74ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1f15caa06dac4f2b952ff64f9e9e74ca", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:44:07.254379 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant: tempest-VolumesActionsTest-2122839514 Jul 12 14:44:07.254379 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Id: 1f15caa06dac4f2b952ff64f9e9e74ca Jul 12 14:44:07.254379 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Name: tempest-VolumesActionsTest-2122839514 Jul 12 14:44:07.254379 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User: tempest-VolumesActionsTest-2122839514-project Jul 12 14:44:07.254379 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Id: default Jul 12 14:44:07.254379 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Name: Default Jul 12 14:44:07.254379 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Id: 9ac06a23a9b84ec38e0712bad9046762 Jul 12 14:44:07.254379 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Name: tempest-VolumesActionsTest-2122839514-project Jul 12 14:44:07.254379 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: method: > Jul 12 14:44:07.254379 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: exception: Instance 10a574c3-5f25-48a6-99e9-464bf90937a9 could not be found. Jul 12 14:44:07.254379 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: action_args: {'id': '10a574c3-5f25-48a6-99e9-464bf90937a9'} Jul 12 14:44:07.255475 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:44:07.255475 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:07.255475 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:44:07.255475 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:44:07.255475 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:44:07.255475 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:44:07.255475 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:44:07.255475 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:44:07.255475 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:44:07.255475 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:44:07.255475 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10a574c3-5f25-48a6-99e9-464bf90937a9 could not be found. Jul 12 14:44:07.255475 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:44:07.255475 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:44:07.255475 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:44:07.255475 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:07.255475 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:44:07.255475 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:44:07.255475 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:44:07.255475 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:44:07.255475 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:44:07.257683 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:44:07.257683 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:44:07.257683 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:44:07.257683 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:44:07.257683 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:44:07.257683 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:44:07.257683 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:44:07.257683 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10a574c3-5f25-48a6-99e9-464bf90937a9 could not be found. Jul 12 14:44:07.257683 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:44:07.257683 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:44:07.257683 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:44:07.257683 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:07.257683 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:44:07.257683 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:44:07.257683 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:44:07.257683 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:44:07.257683 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10a574c3-5f25-48a6-99e9-464bf90937a9 could not be found. Jul 12 14:44:07.257683 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:44:07.258956 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-096d98af-48b2-47e9-82c5-4d92f2d0ced6 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] Returning 404 to user: Instance 10a574c3-5f25-48a6-99e9-464bf90937a9 could not be found. {{(pid=129980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:44:07.258956 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-096d98af-48b2-47e9-82c5-4d92f2d0ced6 tempest-VolumesActionsTest-2122839514 tempest-VolumesActionsTest-2122839514-project] 10.222.0.30 "GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9" status: 404 len: 111 microversion: 2.1 time: 0.031396 Jul 12 14:44:07.258956 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 300/603] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:07 2022] GET /compute/v2.1/servers/10a574c3-5f25-48a6-99e9-464bf90937a9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:44:07.655898 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d4d1b824-8939-4a60-9678-3024ad4ae5b3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:07.657912 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-d4d1b824-8939-4a60-9678-3024ad4ae5b3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:07.664258 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d4d1b824-8939-4a60-9678-3024ad4ae5b3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:07.664715 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d4d1b824-8939-4a60-9678-3024ad4ae5b3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:07.665594 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d4d1b824-8939-4a60-9678-3024ad4ae5b3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:07.666034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d4d1b824-8939-4a60-9678-3024ad4ae5b3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:07.845996 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d4d1b824-8939-4a60-9678-3024ad4ae5b3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:07.856490 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-d4d1b824-8939-4a60-9678-3024ad4ae5b3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1266 microversion: 2.1 time: 0.205203 Jul 12 14:44:07.857597 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 304/604] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:07 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:08.877490 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-f7d57f1b-b9d1-4cb4-98b2-c4c74175da3b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:08.878045 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-f7d57f1b-b9d1-4cb4-98b2-c4c74175da3b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:08.884485 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f7d57f1b-b9d1-4cb4-98b2-c4c74175da3b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:08.884931 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f7d57f1b-b9d1-4cb4-98b2-c4c74175da3b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:08.885711 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f7d57f1b-b9d1-4cb4-98b2-c4c74175da3b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:08.886144 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f7d57f1b-b9d1-4cb4-98b2-c4c74175da3b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:09.017493 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-f7d57f1b-b9d1-4cb4-98b2-c4c74175da3b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:09.024860 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-f7d57f1b-b9d1-4cb4-98b2-c4c74175da3b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1266 microversion: 2.1 time: 0.152100 Jul 12 14:44:09.025453 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 301/605] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:08 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:09.075524 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-846f9a1e-4c8a-4c48-8312-7381e7e45c77 req-3f913fe7-0fc5-47ba-9f3e-f03d8c728c39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a9deddf-4864-4ad7-9f64-51b96f7c45eb", "tag": "12bf018a-5099-450d-857c-a8150eca7139"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:44:09.083918 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-846f9a1e-4c8a-4c48-8312-7381e7e45c77 req-3f913fe7-0fc5-47ba-9f3e-f03d8c728c39 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:09.084411 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-846f9a1e-4c8a-4c48-8312-7381e7e45c77 req-3f913fe7-0fc5-47ba-9f3e-f03d8c728c39 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:09.095147 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-846f9a1e-4c8a-4c48-8312-7381e7e45c77 req-3f913fe7-0fc5-47ba-9f3e-f03d8c728c39 service nova] Creating event network-changed:12bf018a-5099-450d-857c-a8150eca7139 for instance 8a9deddf-4864-4ad7-9f64-51b96f7c45eb on hv-cinder-82002 Jul 12 14:44:09.099880 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-846f9a1e-4c8a-4c48-8312-7381e7e45c77 req-3f913fe7-0fc5-47ba-9f3e-f03d8c728c39 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028073 Jul 12 14:44:09.100469 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 305/606] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:44:10.041446 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-890c48cd-b411-475f-b7b5-bf2f15ea435e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:10.042060 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-890c48cd-b411-475f-b7b5-bf2f15ea435e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:10.048652 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-890c48cd-b411-475f-b7b5-bf2f15ea435e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:10.049112 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-890c48cd-b411-475f-b7b5-bf2f15ea435e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:10.049904 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-890c48cd-b411-475f-b7b5-bf2f15ea435e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:10.050340 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-890c48cd-b411-475f-b7b5-bf2f15ea435e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:10.177913 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-890c48cd-b411-475f-b7b5-bf2f15ea435e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:10.185249 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-890c48cd-b411-475f-b7b5-bf2f15ea435e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1266 microversion: 2.1 time: 0.147663 Jul 12 14:44:10.185819 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 302/607] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:10 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:11.204365 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-7320c510-6617-4819-a0db-db3999973aa0 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:11.205064 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-7320c510-6617-4819-a0db-db3999973aa0 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:11.211252 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7320c510-6617-4819-a0db-db3999973aa0 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:11.211698 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7320c510-6617-4819-a0db-db3999973aa0 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:11.212464 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7320c510-6617-4819-a0db-db3999973aa0 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:11.212895 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7320c510-6617-4819-a0db-db3999973aa0 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:11.347548 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7320c510-6617-4819-a0db-db3999973aa0 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:11.355080 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-7320c510-6617-4819-a0db-db3999973aa0 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1266 microversion: 2.1 time: 0.156075 Jul 12 14:44:11.355649 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 306/608] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:11 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:12.371770 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-e67f1b34-c21a-4b24-bf5b-7b5dc2c59a01 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:12.372384 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-e67f1b34-c21a-4b24-bf5b-7b5dc2c59a01 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:12.379148 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e67f1b34-c21a-4b24-bf5b-7b5dc2c59a01 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:12.379593 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e67f1b34-c21a-4b24-bf5b-7b5dc2c59a01 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:12.380413 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e67f1b34-c21a-4b24-bf5b-7b5dc2c59a01 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:12.380785 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e67f1b34-c21a-4b24-bf5b-7b5dc2c59a01 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:12.508104 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-e67f1b34-c21a-4b24-bf5b-7b5dc2c59a01 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:12.515391 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-e67f1b34-c21a-4b24-bf5b-7b5dc2c59a01 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1266 microversion: 2.1 time: 0.147514 Jul 12 14:44:12.515947 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 303/609] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:12 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:13.532163 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-7c8b354b-01a9-4a82-a036-25659b3797b1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:13.533579 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-7c8b354b-01a9-4a82-a036-25659b3797b1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:13.540773 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7c8b354b-01a9-4a82-a036-25659b3797b1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:13.541352 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7c8b354b-01a9-4a82-a036-25659b3797b1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:13.542373 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7c8b354b-01a9-4a82-a036-25659b3797b1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:13.542964 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7c8b354b-01a9-4a82-a036-25659b3797b1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:13.691088 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7c8b354b-01a9-4a82-a036-25659b3797b1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:13.699765 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-7c8b354b-01a9-4a82-a036-25659b3797b1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1266 microversion: 2.1 time: 0.171549 Jul 12 14:44:13.700756 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 307/610] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:13 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:44:14.716959 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-7349ff4a-2433-4674-bf67-d0764271327d tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:14.717526 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-7349ff4a-2433-4674-bf67-d0764271327d tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:14.725533 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7349ff4a-2433-4674-bf67-d0764271327d tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:14.725533 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7349ff4a-2433-4674-bf67-d0764271327d tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:14.726913 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7349ff4a-2433-4674-bf67-d0764271327d tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:14.727353 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7349ff4a-2433-4674-bf67-d0764271327d tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:14.868911 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-7349ff4a-2433-4674-bf67-d0764271327d tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:14.877627 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-7349ff4a-2433-4674-bf67-d0764271327d tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1266 microversion: 2.1 time: 0.164512 Jul 12 14:44:14.878197 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 304/611] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:14 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:15.895006 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-aaa95d9b-dd1a-43aa-a714-d0cd22d3ba8b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:15.895539 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-aaa95d9b-dd1a-43aa-a714-d0cd22d3ba8b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:15.902106 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-aaa95d9b-dd1a-43aa-a714-d0cd22d3ba8b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:15.902554 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-aaa95d9b-dd1a-43aa-a714-d0cd22d3ba8b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:15.903342 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-aaa95d9b-dd1a-43aa-a714-d0cd22d3ba8b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:15.903758 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-aaa95d9b-dd1a-43aa-a714-d0cd22d3ba8b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:16.040358 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-aaa95d9b-dd1a-43aa-a714-d0cd22d3ba8b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:16.047925 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-aaa95d9b-dd1a-43aa-a714-d0cd22d3ba8b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1266 microversion: 2.1 time: 0.157407 Jul 12 14:44:16.048490 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 308/612] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:15 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:17.063832 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-5288392a-5f3e-41f9-8462-dfe82cd9ee14 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:17.065287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-5288392a-5f3e-41f9-8462-dfe82cd9ee14 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:17.072109 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5288392a-5f3e-41f9-8462-dfe82cd9ee14 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:17.072572 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5288392a-5f3e-41f9-8462-dfe82cd9ee14 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:17.073469 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5288392a-5f3e-41f9-8462-dfe82cd9ee14 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:17.073913 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5288392a-5f3e-41f9-8462-dfe82cd9ee14 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:17.078133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=100 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:17.386941 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-5288392a-5f3e-41f9-8462-dfe82cd9ee14 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:17.397587 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-5288392a-5f3e-41f9-8462-dfe82cd9ee14 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1266 microversion: 2.1 time: 0.337284 Jul 12 14:44:17.398875 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 305/613] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:17 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1266 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:17.492675 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-470e32f5-d94d-48c0-bf88-58c29ee2faa6 req-4457c953-3751-4b88-94a8-db248418fa69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01cf8542-b5a1-4e34-a424-41d130ff60b6", "name": "network-vif-plugged", "status": "completed", "tag": "04f81fac-5835-4383-819e-c1a0c737643b"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:44:17.503502 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-470e32f5-d94d-48c0-bf88-58c29ee2faa6 req-4457c953-3751-4b88-94a8-db248418fa69 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:17.504460 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-470e32f5-d94d-48c0-bf88-58c29ee2faa6 req-4457c953-3751-4b88-94a8-db248418fa69 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:17.517748 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-470e32f5-d94d-48c0-bf88-58c29ee2faa6 req-4457c953-3751-4b88-94a8-db248418fa69 service nova] Creating event network-vif-plugged:04f81fac-5835-4383-819e-c1a0c737643b for instance 01cf8542-b5a1-4e34-a424-41d130ff60b6 on hv-cinder-82002 Jul 12 14:44:17.523342 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-470e32f5-d94d-48c0-bf88-58c29ee2faa6 req-4457c953-3751-4b88-94a8-db248418fa69 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035241 Jul 12 14:44:17.524534 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 309/614] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:44:18.127836 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-72ff3cde-b619-4774-ad74-76b8f64f2e14 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:18.129046 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-72ff3cde-b619-4774-ad74-76b8f64f2e14 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:18.136525 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-72ff3cde-b619-4774-ad74-76b8f64f2e14 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:18.138452 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-72ff3cde-b619-4774-ad74-76b8f64f2e14 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:18.139495 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-72ff3cde-b619-4774-ad74-76b8f64f2e14 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:18.140479 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-72ff3cde-b619-4774-ad74-76b8f64f2e14 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:18.182593 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-72ff3cde-b619-4774-ad74-76b8f64f2e14 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a/os-volume_attachments/9e95dfbf-d45a-4b9c-906b-b0a76306cd18" status: 200 len: 194 microversion: 2.20 time: 0.059399 Jul 12 14:44:18.200145 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 306/615] 10.222.0.30 () {60 vars in 1453 bytes} [Tue Jul 12 14:44:18 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a/os-volume_attachments/9e95dfbf-d45a-4b9c-906b-b0a76306cd18 => generated 194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:44:18.254424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-7fbc384a-556d-474c-850b-ba1ddaae36b6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:18.254803 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-7fbc384a-556d-474c-850b-ba1ddaae36b6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:18.262725 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7fbc384a-556d-474c-850b-ba1ddaae36b6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:18.263427 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7fbc384a-556d-474c-850b-ba1ddaae36b6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:18.264375 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7fbc384a-556d-474c-850b-ba1ddaae36b6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:18.264967 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7fbc384a-556d-474c-850b-ba1ddaae36b6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:18.414751 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-4cda6994-d7f3-4f83-bad1-6d0b76045286 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:18.415603 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-4cda6994-d7f3-4f83-bad1-6d0b76045286 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:18.425144 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4cda6994-d7f3-4f83-bad1-6d0b76045286 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:18.425646 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4cda6994-d7f3-4f83-bad1-6d0b76045286 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:18.426402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4cda6994-d7f3-4f83-bad1-6d0b76045286 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:18.426843 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4cda6994-d7f3-4f83-bad1-6d0b76045286 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:18.526749 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.objects.instance [None req-7fbc384a-556d-474c-850b-ba1ddaae36b6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lazy-loading 'services' on Instance uuid 26eeea2d-c1c2-46a7-b727-269cf6dce92a {{(pid=129981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:44:18.644407 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-4cda6994-d7f3-4f83-bad1-6d0b76045286 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:18.653121 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-4cda6994-d7f3-4f83-bad1-6d0b76045286 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1266 microversion: 2.1 time: 0.242625 Jul 12 14:44:18.662788 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 307/616] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:18 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:44:18.760533 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-7fbc384a-556d-474c-850b-ba1ddaae36b6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "DELETE /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a/os-volume_attachments/9e95dfbf-d45a-4b9c-906b-b0a76306cd18" status: 202 len: 0 microversion: 2.20 time: 0.511019 Jul 12 14:44:18.764682 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 310/617] 10.222.0.30 () {60 vars in 1456 bytes} [Tue Jul 12 14:44:18 2022] DELETE /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a/os-volume_attachments/9e95dfbf-d45a-4b9c-906b-b0a76306cd18 => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:44:18.770859 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-806b710c-088b-49cd-9f88-ccda7d897e8f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:18.771935 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-806b710c-088b-49cd-9f88-ccda7d897e8f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:18.778942 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-806b710c-088b-49cd-9f88-ccda7d897e8f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:18.779670 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-806b710c-088b-49cd-9f88-ccda7d897e8f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:18.780696 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-806b710c-088b-49cd-9f88-ccda7d897e8f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:18.781503 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-806b710c-088b-49cd-9f88-ccda7d897e8f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:18.814200 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-806b710c-088b-49cd-9f88-ccda7d897e8f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047008 Jul 12 14:44:18.815001 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 308/618] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Jul 12 14:44:18 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:44:19.671445 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e89070ac-8eda-4e48-abc1-a8e5b6754fae tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:19.672071 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-e89070ac-8eda-4e48-abc1-a8e5b6754fae tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:19.679724 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e89070ac-8eda-4e48-abc1-a8e5b6754fae tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:19.680177 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e89070ac-8eda-4e48-abc1-a8e5b6754fae tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:19.680977 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e89070ac-8eda-4e48-abc1-a8e5b6754fae tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:19.681453 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e89070ac-8eda-4e48-abc1-a8e5b6754fae tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:19.825431 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-238fd7df-13c3-420c-bf23-3937ced9bc6d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:19.827460 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-238fd7df-13c3-420c-bf23-3937ced9bc6d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:19.833832 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e89070ac-8eda-4e48-abc1-a8e5b6754fae tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:19.837759 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-238fd7df-13c3-420c-bf23-3937ced9bc6d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:19.838191 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-238fd7df-13c3-420c-bf23-3937ced9bc6d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:19.838966 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-238fd7df-13c3-420c-bf23-3937ced9bc6d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:19.839404 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-238fd7df-13c3-420c-bf23-3937ced9bc6d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:19.842303 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-e89070ac-8eda-4e48-abc1-a8e5b6754fae tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1266 microversion: 2.1 time: 0.175852 Jul 12 14:44:19.848656 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 311/619] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:19 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:19.877330 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-238fd7df-13c3-420c-bf23-3937ced9bc6d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055890 Jul 12 14:44:19.880290 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 309/620] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Jul 12 14:44:19 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 14:44:20.859784 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-94583d10-0b14-4970-a12f-24234a0b2b8e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:20.860658 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-94583d10-0b14-4970-a12f-24234a0b2b8e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:20.867462 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-94583d10-0b14-4970-a12f-24234a0b2b8e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:20.868213 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-94583d10-0b14-4970-a12f-24234a0b2b8e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:20.870237 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-94583d10-0b14-4970-a12f-24234a0b2b8e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:20.870795 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-94583d10-0b14-4970-a12f-24234a0b2b8e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:20.888716 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-9b266c19-bbf4-440a-b600-e368a32ccac6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:20.891179 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-9b266c19-bbf4-440a-b600-e368a32ccac6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:20.902579 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9b266c19-bbf4-440a-b600-e368a32ccac6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:20.904744 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9b266c19-bbf4-440a-b600-e368a32ccac6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:20.906818 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9b266c19-bbf4-440a-b600-e368a32ccac6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:20.907694 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9b266c19-bbf4-440a-b600-e368a32ccac6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:20.945432 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-9b266c19-bbf4-440a-b600-e368a32ccac6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060563 Jul 12 14:44:20.946565 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 310/621] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Jul 12 14:44:20 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:44:21.051288 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-94583d10-0b14-4970-a12f-24234a0b2b8e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:21.059062 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-94583d10-0b14-4970-a12f-24234a0b2b8e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1452 microversion: 2.1 time: 0.203166 Jul 12 14:44:21.060238 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 312/622] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:20 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1452 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:21.081490 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-1cbb73ef-aeaa-4029-9390-401b9eac54fb tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:21.087244 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-1cbb73ef-aeaa-4029-9390-401b9eac54fb tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:21.099959 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1cbb73ef-aeaa-4029-9390-401b9eac54fb tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:21.100575 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1cbb73ef-aeaa-4029-9390-401b9eac54fb tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:21.101394 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1cbb73ef-aeaa-4029-9390-401b9eac54fb tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:21.101843 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1cbb73ef-aeaa-4029-9390-401b9eac54fb tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:21.293419 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-1cbb73ef-aeaa-4029-9390-401b9eac54fb tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:21.301592 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-1cbb73ef-aeaa-4029-9390-401b9eac54fb tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1452 microversion: 2.1 time: 0.224167 Jul 12 14:44:21.302332 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 311/623] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:21 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1452 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:21.958329 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-f586b5fd-2287-4b13-bd11-59d39fd212ae tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:21.959562 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-f586b5fd-2287-4b13-bd11-59d39fd212ae tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:21.974366 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f586b5fd-2287-4b13-bd11-59d39fd212ae tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:21.975903 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f586b5fd-2287-4b13-bd11-59d39fd212ae tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:21.978300 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f586b5fd-2287-4b13-bd11-59d39fd212ae tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:21.980063 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f586b5fd-2287-4b13-bd11-59d39fd212ae tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:22.001904 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:22.021765 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-f586b5fd-2287-4b13-bd11-59d39fd212ae tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.067721 Jul 12 14:44:22.023000 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 313/624] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Jul 12 14:44:21 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:22.105097 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-5e20bdbf-e27d-47ce-a3fe-928e6162055a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:22.107056 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-5e20bdbf-e27d-47ce-a3fe-928e6162055a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:22.115698 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5e20bdbf-e27d-47ce-a3fe-928e6162055a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:22.116345 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5e20bdbf-e27d-47ce-a3fe-928e6162055a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:22.117497 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5e20bdbf-e27d-47ce-a3fe-928e6162055a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:22.120507 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5e20bdbf-e27d-47ce-a3fe-928e6162055a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:22.148845 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-5e20bdbf-e27d-47ce-a3fe-928e6162055a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Going to try to terminate instance {{(pid=129980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:44:22.483296 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-5e20bdbf-e27d-47ce-a3fe-928e6162055a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "DELETE /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 204 len: 0 microversion: 2.20 time: 0.381983 Jul 12 14:44:22.483882 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 312/625] 10.222.0.30 () {60 vars in 1279 bytes} [Tue Jul 12 14:44:22 2022] DELETE /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 14:44:22.492480 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-7399bdf8-b0fc-4afa-9dc4-1a4ab9d9fc95 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:22.493109 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-7399bdf8-b0fc-4afa-9dc4-1a4ab9d9fc95 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:22.500995 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7399bdf8-b0fc-4afa-9dc4-1a4ab9d9fc95 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:22.501487 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7399bdf8-b0fc-4afa-9dc4-1a4ab9d9fc95 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:22.502269 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7399bdf8-b0fc-4afa-9dc4-1a4ab9d9fc95 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:22.502895 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7399bdf8-b0fc-4afa-9dc4-1a4ab9d9fc95 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:22.680503 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7399bdf8-b0fc-4afa-9dc4-1a4ab9d9fc95 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:22.688529 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7399bdf8-b0fc-4afa-9dc4-1a4ab9d9fc95 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:22.694599 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7399bdf8-b0fc-4afa-9dc4-1a4ab9d9fc95 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:22.695755 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-7399bdf8-b0fc-4afa-9dc4-1a4ab9d9fc95 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1723 microversion: 2.20 time: 0.207298 Jul 12 14:44:22.696311 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 314/626] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:44:22 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:44:23.655654 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-10b262d8-402f-426a-9b06-bbceb485e793 req-8ff5c488-c048-4fe8-be9a-1e3081ac0b31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01cf8542-b5a1-4e34-a424-41d130ff60b6", "tag": "04f81fac-5835-4383-819e-c1a0c737643b"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:44:23.666275 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-10b262d8-402f-426a-9b06-bbceb485e793 req-8ff5c488-c048-4fe8-be9a-1e3081ac0b31 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:23.666970 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-10b262d8-402f-426a-9b06-bbceb485e793 req-8ff5c488-c048-4fe8-be9a-1e3081ac0b31 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:23.679971 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-10b262d8-402f-426a-9b06-bbceb485e793 req-8ff5c488-c048-4fe8-be9a-1e3081ac0b31 service nova] Creating event network-changed:04f81fac-5835-4383-819e-c1a0c737643b for instance 01cf8542-b5a1-4e34-a424-41d130ff60b6 on hv-cinder-82002 Jul 12 14:44:23.686668 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-10b262d8-402f-426a-9b06-bbceb485e793 req-8ff5c488-c048-4fe8-be9a-1e3081ac0b31 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034917 Jul 12 14:44:23.693691 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 313/627] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:44:23.718033 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-be829c61-c926-4879-a260-479eed00b6ce tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:23.720422 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-be829c61-c926-4879-a260-479eed00b6ce tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:23.731808 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-be829c61-c926-4879-a260-479eed00b6ce tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:23.732559 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-be829c61-c926-4879-a260-479eed00b6ce tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:23.733571 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-be829c61-c926-4879-a260-479eed00b6ce tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:23.734201 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-be829c61-c926-4879-a260-479eed00b6ce tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:23.927281 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-be829c61-c926-4879-a260-479eed00b6ce tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:23.940613 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-be829c61-c926-4879-a260-479eed00b6ce tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:23.943577 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-be829c61-c926-4879-a260-479eed00b6ce tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:23.945229 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-be829c61-c926-4879-a260-479eed00b6ce tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1723 microversion: 2.20 time: 0.233617 Jul 12 14:44:23.946969 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 315/628] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:44:23 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:44:24.965015 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-f2e23118-aada-4c87-9c88-b03e746e6849 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:24.966053 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-f2e23118-aada-4c87-9c88-b03e746e6849 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:24.977526 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f2e23118-aada-4c87-9c88-b03e746e6849 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:24.978340 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f2e23118-aada-4c87-9c88-b03e746e6849 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:24.979386 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f2e23118-aada-4c87-9c88-b03e746e6849 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:24.979842 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f2e23118-aada-4c87-9c88-b03e746e6849 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:25.189780 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-f2e23118-aada-4c87-9c88-b03e746e6849 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:25.199798 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-f2e23118-aada-4c87-9c88-b03e746e6849 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:25.201821 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-f2e23118-aada-4c87-9c88-b03e746e6849 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:25.203035 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-f2e23118-aada-4c87-9c88-b03e746e6849 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1723 microversion: 2.20 time: 0.242891 Jul 12 14:44:25.203610 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 314/629] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:44:24 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:44:26.237941 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-50ac3918-cd9b-40b0-bc71-df5a94a3699f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:26.240388 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-50ac3918-cd9b-40b0-bc71-df5a94a3699f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:26.256162 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-50ac3918-cd9b-40b0-bc71-df5a94a3699f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:26.256956 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-50ac3918-cd9b-40b0-bc71-df5a94a3699f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:26.258297 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-50ac3918-cd9b-40b0-bc71-df5a94a3699f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:26.259101 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-50ac3918-cd9b-40b0-bc71-df5a94a3699f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:26.524563 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-50ac3918-cd9b-40b0-bc71-df5a94a3699f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:26.544098 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-50ac3918-cd9b-40b0-bc71-df5a94a3699f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:26.549234 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-50ac3918-cd9b-40b0-bc71-df5a94a3699f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:26.551202 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-50ac3918-cd9b-40b0-bc71-df5a94a3699f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1656 microversion: 2.20 time: 0.325329 Jul 12 14:44:26.565645 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 316/630] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:44:26 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1656 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:44:26.730037 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-ba232de9-93e6-4cd4-8327-b65fa1f848a2 req-2fd715e1-228e-4ed0-8be5-672de974fa75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26eeea2d-c1c2-46a7-b727-269cf6dce92a", "name": "network-vif-deleted", "tag": "f0edff70-5e51-412d-b474-2a70b09725f5"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:44:26.753655 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-ba232de9-93e6-4cd4-8327-b65fa1f848a2 req-2fd715e1-228e-4ed0-8be5-672de974fa75 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:26.756224 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-ba232de9-93e6-4cd4-8327-b65fa1f848a2 req-2fd715e1-228e-4ed0-8be5-672de974fa75 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:26.788367 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-ba232de9-93e6-4cd4-8327-b65fa1f848a2 req-2fd715e1-228e-4ed0-8be5-672de974fa75 service nova] Creating event network-vif-deleted:f0edff70-5e51-412d-b474-2a70b09725f5 for instance 26eeea2d-c1c2-46a7-b727-269cf6dce92a on hv-cinder-82002 Jul 12 14:44:26.800739 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-ba232de9-93e6-4cd4-8327-b65fa1f848a2 req-2fd715e1-228e-4ed0-8be5-672de974fa75 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074185 Jul 12 14:44:26.807973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 315/631] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:44:27.577136 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-3f65f576-2e1e-446e-8542-d1802e7b233a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:27.580223 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-3f65f576-2e1e-446e-8542-d1802e7b233a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:27.595919 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3f65f576-2e1e-446e-8542-d1802e7b233a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:27.595919 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3f65f576-2e1e-446e-8542-d1802e7b233a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:27.595919 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3f65f576-2e1e-446e-8542-d1802e7b233a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:27.595919 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3f65f576-2e1e-446e-8542-d1802e7b233a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:27.652909 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3f65f576-2e1e-446e-8542-d1802e7b233a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:27.656016 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3f65f576-2e1e-446e-8542-d1802e7b233a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:27.656629 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.objects.instance [None req-3f65f576-2e1e-446e-8542-d1802e7b233a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lazy-loading 'fault' on Instance uuid 26eeea2d-c1c2-46a7-b727-269cf6dce92a {{(pid=129981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:44:27.712263 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-3f65f576-2e1e-446e-8542-d1802e7b233a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:27.724079 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-3f65f576-2e1e-446e-8542-d1802e7b233a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:27.731110 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-3f65f576-2e1e-446e-8542-d1802e7b233a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:27.731110 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-3f65f576-2e1e-446e-8542-d1802e7b233a tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 200 len: 1372 microversion: 2.20 time: 0.156826 Jul 12 14:44:27.731110 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 317/632] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:44:27 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:44:28.751678 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-44007f2e-a522-4ce5-928e-e55abd00e476 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:28.752524 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-44007f2e-a522-4ce5-928e-e55abd00e476 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:28.779755 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-44007f2e-a522-4ce5-928e-e55abd00e476 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:28.781025 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-44007f2e-a522-4ce5-928e-e55abd00e476 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:28.783439 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-44007f2e-a522-4ce5-928e-e55abd00e476 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:28.784444 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-44007f2e-a522-4ce5-928e-e55abd00e476 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:28.817006 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.wsgi [None req-44007f2e-a522-4ce5-928e-e55abd00e476 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] HTTP exception thrown: Instance 26eeea2d-c1c2-46a7-b727-269cf6dce92a could not be found. Jul 12 14:44:28.819657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-44007f2e-a522-4ce5-928e-e55abd00e476 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Request method failure captured: Jul 12 14:44:28.819657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: request: GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a HTTP/1.1 Jul 12 14:44:28.819657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept: application/json Jul 12 14:44:28.819657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept-Encoding: identity Jul 12 14:44:28.819657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Connection: close Jul 12 14:44:28.819657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Length: 0 Jul 12 14:44:28.819657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Type: application/json Jul 12 14:44:28.819657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Host: 10.222.0.30 Jul 12 14:44:28.819657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Openstack-System-Scope: None Jul 12 14:44:28.819657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: User-Agent: python-urllib3/1.26.9 Jul 12 14:44:28.819657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Auth-Token: gAAAAABizYejT2P3PiUiEByA0PbthfldEiHy-gqWe4ATY_chIHCmw1L4xElkXSKZFoveQ2Vy9e6GTBHKsq6PzAANaD1hqevHlqvWzCwKlSXOX29eu6zKkuQ4T2Vx7BSS8d6YyFqglKlOjCEvJ_v29O9Hr8yZz3RfWPLKznIZhJmQLG8C7m9nDUs Jul 12 14:44:28.819657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Id: None Jul 12 14:44:28.819657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Name: None Jul 12 14:44:28.819657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Identity-Status: Confirmed Jul 12 14:44:28.819657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Is-Admin-Project: True Jul 12 14:44:28.819657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 14:44:28.819657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Id: default Jul 12 14:44:28.819657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Name: Default Jul 12 14:44:28.819657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Id: 3f550f8d11a74b8da5ad84607b79ac37 Jul 12 14:44:28.819657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-176723160 Jul 12 14:44:28.819657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Role: member,reader Jul 12 14:44:28.819657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Roles: member,reader Jul 12 14:44:28.821188 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f550f8d11a74b8da5ad84607b79ac37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f550f8d11a74b8da5ad84607b79ac37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f550f8d11a74b8da5ad84607b79ac37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f550f8d11a74b8da5ad84607b79ac37", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:44:28.821188 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant: tempest-AttachVolumeShelveTestJSON-176723160 Jul 12 14:44:28.821188 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Id: 3f550f8d11a74b8da5ad84607b79ac37 Jul 12 14:44:28.821188 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-176723160 Jul 12 14:44:28.821188 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User: tempest-AttachVolumeShelveTestJSON-176723160-project Jul 12 14:44:28.821188 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Id: default Jul 12 14:44:28.821188 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Name: Default Jul 12 14:44:28.821188 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Id: a760d437b597441fa9a4595995c5bc6f Jul 12 14:44:28.821188 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Name: tempest-AttachVolumeShelveTestJSON-176723160-project Jul 12 14:44:28.821188 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: method: > Jul 12 14:44:28.821188 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: exception: Instance 26eeea2d-c1c2-46a7-b727-269cf6dce92a could not be found. Jul 12 14:44:28.821188 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: action_args: {'id': '26eeea2d-c1c2-46a7-b727-269cf6dce92a'} Jul 12 14:44:28.822133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:44:28.822133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:28.822133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:44:28.822133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:44:28.822133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:44:28.822133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:44:28.822133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:44:28.822133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:44:28.822133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:44:28.822133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:44:28.822133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26eeea2d-c1c2-46a7-b727-269cf6dce92a could not be found. Jul 12 14:44:28.822133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:44:28.822133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:44:28.822133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:44:28.822133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:28.822133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:44:28.822133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:44:28.822133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:44:28.822133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:44:28.822133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:44:28.823530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:44:28.823530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:44:28.823530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:44:28.823530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:44:28.823530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:44:28.823530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:44:28.823530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:44:28.823530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26eeea2d-c1c2-46a7-b727-269cf6dce92a could not be found. Jul 12 14:44:28.823530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:44:28.823530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:44:28.823530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:44:28.823530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:28.823530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:44:28.823530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:44:28.823530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:44:28.823530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:44:28.823530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26eeea2d-c1c2-46a7-b727-269cf6dce92a could not be found. Jul 12 14:44:28.823530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:44:28.827007 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-44007f2e-a522-4ce5-928e-e55abd00e476 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Returning 404 to user: Instance 26eeea2d-c1c2-46a7-b727-269cf6dce92a could not be found. {{(pid=129980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:44:28.828090 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-44007f2e-a522-4ce5-928e-e55abd00e476 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 404 len: 111 microversion: 2.20 time: 0.082794 Jul 12 14:44:28.832814 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 316/633] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:44:28 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 14:44:28.837791 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-6898f981-142e-4c18-9bf0-2546b1e54e46 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '.version_select at 0x7f962c86a5e0>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:28.843683 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6898f981-142e-4c18-9bf0-2546b1e54e46 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [3111d631-5c7d-44f3-844a-7c20262c6ea3] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 12 14:44:29.853351 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO oslo.messaging._drivers.impl_rabbit [None req-6898f981-142e-4c18-9bf0-2546b1e54e46 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [3111d631-5c7d-44f3-844a-7c20262c6ea3] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 58264. Jul 12 14:44:29.861115 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:29.975031 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-6898f981-142e-4c18-9bf0-2546b1e54e46 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1576898000" status: 204 len: 0 microversion: 2.20 time: 1.141260 Jul 12 14:44:29.975609 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 318/634] 10.222.0.30 () {60 vars in 1261 bytes} [Tue Jul 12 14:44:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1576898000 => generated 0 bytes in 1143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 12 14:44:30.165789 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-bffc578a-8dcf-485e-9e0e-ddbc22750527 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1421566928"}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:44:30.166413 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-bffc578a-8dcf-485e-9e0e-ddbc22750527 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:30.168761 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:30.173811 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bffc578a-8dcf-485e-9e0e-ddbc22750527 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:30.174255 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bffc578a-8dcf-485e-9e0e-ddbc22750527 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:30.175071 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bffc578a-8dcf-485e-9e0e-ddbc22750527 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:30.175432 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bffc578a-8dcf-485e-9e0e-ddbc22750527 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:30.341095 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.network.security_group_api [None req-bffc578a-8dcf-485e-9e0e-ddbc22750527 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Removing security group b2d1e4c1-5d97-4af9-9c98-5c4ab65a3224 from port 158072fd-c24f-4080-926d-9613cf2adbd5 Jul 12 14:44:30.745409 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-bffc578a-8dcf-485e-9e0e-ddbc22750527 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "POST /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca/action" status: 202 len: 0 microversion: 2.1 time: 0.582638 Jul 12 14:44:30.745409 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 317/635] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Jul 12 14:44:30 2022] POST /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca/action => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:44:30.762204 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-f9da57d7-207d-4261-bcb3-d82330cf9759 req-c7f19821-7673-42e0-8a33-61cac8ba8f69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84cf1792-70fc-4b57-a953-74848c1eb8ca", "tag": "158072fd-c24f-4080-926d-9613cf2adbd5"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:44:30.782575 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-f9da57d7-207d-4261-bcb3-d82330cf9759 req-c7f19821-7673-42e0-8a33-61cac8ba8f69 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:30.783149 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-f9da57d7-207d-4261-bcb3-d82330cf9759 req-c7f19821-7673-42e0-8a33-61cac8ba8f69 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:30.809266 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-34c4fa36-d3fa-4807-be35-a69bceb4b7de tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Action: 'create', calling method: .version_select at 0x7f962cb5dc10>, body: {"keypair": {"name": "tempest-keypair-1154020839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhjCM3NsxjqzzJpreOsPgY1+aayUfgzO67kTkI+2HIX0Eo7qgDaHIW6XWdOzwEEza3WyDTamt7D7ywWJwta+4hYDT2LgdYRHoxxsQ7H74PxNN3ViZmJh2AgQgGXIZQuYA=="}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:44:30.809403 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-f9da57d7-207d-4261-bcb3-d82330cf9759 req-c7f19821-7673-42e0-8a33-61cac8ba8f69 service nova] Creating event network-changed:158072fd-c24f-4080-926d-9613cf2adbd5 for instance 84cf1792-70fc-4b57-a953-74848c1eb8ca on hv-cinder-82002 Jul 12 14:44:30.809403 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-f9da57d7-207d-4261-bcb3-d82330cf9759 req-c7f19821-7673-42e0-8a33-61cac8ba8f69 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045735 Jul 12 14:44:30.809403 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 319/636] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:44:30.817223 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-34c4fa36-d3fa-4807-be35-a69bceb4b7de tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Getting quotas for project 3f550f8d11a74b8da5ad84607b79ac37. Resources: {'key_pairs'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:44:30.823411 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-34c4fa36-d3fa-4807-be35-a69bceb4b7de tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Getting quotas for user a760d437b597441fa9a4595995c5bc6f and project 3f550f8d11a74b8da5ad84607b79ac37. Resources: {'key_pairs'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:44:30.918719 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-34c4fa36-d3fa-4807-be35-a69bceb4b7de tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.130597 Jul 12 14:44:30.919839 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 318/637] 10.222.0.30 () {62 vars in 1199 bytes} [Tue Jul 12 14:44:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 132 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 12 14:44:32.253473 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-68c3dde2-7fef-40f0-ae90-e863a60b8b1a tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:32.254068 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-68c3dde2-7fef-40f0-ae90-e863a60b8b1a tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:32.255292 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-d5f22db9-ad0c-4561-93f0-14d032e5b886 req-0d8183a4-dad2-4e45-8fd1-42ac1f8c61c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84cf1792-70fc-4b57-a953-74848c1eb8ca", "tag": "158072fd-c24f-4080-926d-9613cf2adbd5"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:44:32.260912 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-68c3dde2-7fef-40f0-ae90-e863a60b8b1a tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:32.261401 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-68c3dde2-7fef-40f0-ae90-e863a60b8b1a tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:32.262178 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-68c3dde2-7fef-40f0-ae90-e863a60b8b1a tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:32.262614 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-68c3dde2-7fef-40f0-ae90-e863a60b8b1a tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:32.263873 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-d5f22db9-ad0c-4561-93f0-14d032e5b886 req-0d8183a4-dad2-4e45-8fd1-42ac1f8c61c2 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:32.264325 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-d5f22db9-ad0c-4561-93f0-14d032e5b886 req-0d8183a4-dad2-4e45-8fd1-42ac1f8c61c2 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:32.278164 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-d5f22db9-ad0c-4561-93f0-14d032e5b886 req-0d8183a4-dad2-4e45-8fd1-42ac1f8c61c2 service nova] Creating event network-changed:158072fd-c24f-4080-926d-9613cf2adbd5 for instance 84cf1792-70fc-4b57-a953-74848c1eb8ca on hv-cinder-82002 Jul 12 14:44:32.286004 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-d5f22db9-ad0c-4561-93f0-14d032e5b886 req-0d8183a4-dad2-4e45-8fd1-42ac1f8c61c2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035497 Jul 12 14:44:32.286964 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 319/638] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:44:32.357250 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.objects.instance [None req-68c3dde2-7fef-40f0-ae90-e863a60b8b1a tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lazy-loading 'services' on Instance uuid 84cf1792-70fc-4b57-a953-74848c1eb8ca {{(pid=129981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:44:32.615222 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-68c3dde2-7fef-40f0-ae90-e863a60b8b1a tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "DELETE /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca/os-volume_attachments/b75d8f04-6db7-457c-bdb6-ce7859f3aaf4" status: 202 len: 0 microversion: 2.1 time: 0.367571 Jul 12 14:44:32.616428 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 320/639] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Jul 12 14:44:32 2022] DELETE /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca/os-volume_attachments/b75d8f04-6db7-457c-bdb6-ce7859f3aaf4 => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:44:32.625971 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-6a91a7fb-b66f-4cec-be8e-2d30a18d99ea tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:32.627160 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-6a91a7fb-b66f-4cec-be8e-2d30a18d99ea tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:32.639183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6a91a7fb-b66f-4cec-be8e-2d30a18d99ea tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:32.640465 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6a91a7fb-b66f-4cec-be8e-2d30a18d99ea tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:32.640465 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6a91a7fb-b66f-4cec-be8e-2d30a18d99ea tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:32.640853 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6a91a7fb-b66f-4cec-be8e-2d30a18d99ea tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:32.691154 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-6a91a7fb-b66f-4cec-be8e-2d30a18d99ea tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069954 Jul 12 14:44:32.695256 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 320/640] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Jul 12 14:44:32 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:44:33.702774 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-4b8de966-8a80-47ff-bc24-5a7030968800 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:33.704102 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-4b8de966-8a80-47ff-bc24-5a7030968800 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:33.711904 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4b8de966-8a80-47ff-bc24-5a7030968800 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:33.712428 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4b8de966-8a80-47ff-bc24-5a7030968800 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:33.713442 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4b8de966-8a80-47ff-bc24-5a7030968800 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:33.714132 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4b8de966-8a80-47ff-bc24-5a7030968800 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:33.744259 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-4b8de966-8a80-47ff-bc24-5a7030968800 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045794 Jul 12 14:44:33.744804 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 321/641] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Jul 12 14:44:33 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:44:33.846399 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-b132d9e9-f8c1-48d1-939a-f4eb6efdc1dd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-194579103", "imageRef": "a66ccacb-7b1e-4f51-9eaf-069a356e0fdb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c65826f1-3839-4331-9c1c-eca62ef0fb22"}], "security_groups": [{"name": "tempest-securitygroup--942663967"}], "key_name": "tempest-keypair-1154020839", "user_data": "}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:44:33.951585 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.network.neutron [None req-b132d9e9-f8c1-48d1-939a-f4eb6efdc1dd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] validate_networks() for [('c65826f1-3839-4331-9c1c-eca62ef0fb22', None, None, None, None, None)] {{(pid=129980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:44:34.326975 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-b132d9e9-f8c1-48d1-939a-f4eb6efdc1dd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Flavor limits 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:44:34.327419 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-b132d9e9-f8c1-48d1-939a-f4eb6efdc1dd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Image limits 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:44:34.327875 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-b132d9e9-f8c1-48d1-939a-f4eb6efdc1dd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Flavor pref 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:44:34.328286 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-b132d9e9-f8c1-48d1-939a-f4eb6efdc1dd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Image pref 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:44:34.328700 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-b132d9e9-f8c1-48d1-939a-f4eb6efdc1dd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:44:34.338229 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b132d9e9-f8c1-48d1-939a-f4eb6efdc1dd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:34.338673 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b132d9e9-f8c1-48d1-939a-f4eb6efdc1dd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:34.339466 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b132d9e9-f8c1-48d1-939a-f4eb6efdc1dd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:34.339901 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b132d9e9-f8c1-48d1-939a-f4eb6efdc1dd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:34.356399 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-b132d9e9-f8c1-48d1-939a-f4eb6efdc1dd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Getting quotas for project 3f550f8d11a74b8da5ad84607b79ac37. Resources: {'instances', 'cores', 'ram'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:44:34.360368 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-b132d9e9-f8c1-48d1-939a-f4eb6efdc1dd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Getting quotas for user a760d437b597441fa9a4595995c5bc6f and project 3f550f8d11a74b8da5ad84607b79ac37. Resources: {'instances', 'cores', 'ram'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:44:34.371759 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-b132d9e9-f8c1-48d1-939a-f4eb6efdc1dd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Going to run 1 instances... {{(pid=129980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:44:34.376302 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-b132d9e9-f8c1-48d1-939a-f4eb6efdc1dd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a66ccacb-7b1e-4f51-9eaf-069a356e0fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:44:34.528924 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-b132d9e9-f8c1-48d1-939a-f4eb6efdc1dd tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.686783 Jul 12 14:44:34.529716 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 321/642] 10.222.0.30 () {62 vars in 1187 bytes} [Tue Jul 12 14:44:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 14:44:34.539950 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-a21fae62-5708-418c-9611-a17fa2ab8339 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:34.540550 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-a21fae62-5708-418c-9611-a17fa2ab8339 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:34.599850 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-a21fae62-5708-418c-9611-a17fa2ab8339 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:34.608957 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-a21fae62-5708-418c-9611-a17fa2ab8339 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:34.611385 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-a21fae62-5708-418c-9611-a17fa2ab8339 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:34.612586 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-a21fae62-5708-418c-9611-a17fa2ab8339 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1281 microversion: 2.20 time: 0.076654 Jul 12 14:44:34.623233 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 322/643] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:44:34 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1281 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:44:34.757106 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-236003c5-0ccc-4515-afe0-5c13fe2cd3eb tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:34.758151 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-236003c5-0ccc-4515-afe0-5c13fe2cd3eb tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:34.765236 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-236003c5-0ccc-4515-afe0-5c13fe2cd3eb tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:34.765862 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-236003c5-0ccc-4515-afe0-5c13fe2cd3eb tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:34.766974 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-236003c5-0ccc-4515-afe0-5c13fe2cd3eb tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:34.767416 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-236003c5-0ccc-4515-afe0-5c13fe2cd3eb tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:34.808972 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-236003c5-0ccc-4515-afe0-5c13fe2cd3eb tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055808 Jul 12 14:44:34.810019 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 322/644] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Jul 12 14:44:34 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 14:44:34.820136 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c5830e21-a4db-44ee-b7e7-12b7bf549381 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:34.820615 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-c5830e21-a4db-44ee-b7e7-12b7bf549381 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:34.828561 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c5830e21-a4db-44ee-b7e7-12b7bf549381 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:34.829003 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c5830e21-a4db-44ee-b7e7-12b7bf549381 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:34.829824 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c5830e21-a4db-44ee-b7e7-12b7bf549381 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:34.830237 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c5830e21-a4db-44ee-b7e7-12b7bf549381 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:34.906681 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.wsgi [None req-c5830e21-a4db-44ee-b7e7-12b7bf549381 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] HTTP exception thrown: Instance 84cf1792-70fc-4b57-a953-74848c1eb8ca is not attached to volume b75d8f04-6db7-457c-bdb6-ce7859f3aaf4 Jul 12 14:44:34.916371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c5830e21-a4db-44ee-b7e7-12b7bf549381 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Request method failure captured: Jul 12 14:44:34.916371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: DELETE /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca/os-volume_attachments/b75d8f04-6db7-457c-bdb6-ce7859f3aaf4 HTTP/1.1 Jul 12 14:44:34.916371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:44:34.916371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:44:34.916371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:44:34.916371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 0 Jul 12 14:44:34.916371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:44:34.916371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:44:34.916371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:44:34.916371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:44:34.916371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYfzD0fQFnuJ1n9dVeirw6UMGVn1GYaEEALPoUetW2V5EKJ3UNuOn0oWMEyFN0hh34C8QT8gvcWyoZgIxXQ4UkyCHnqKT3eaEf03skmvHbuNWQ6OAMDHcjKQD5LP87iGJofs8hAf_jGO6LqSqlFqhvhDwmZoot8gmN8ttHEtNmYLQVY Jul 12 14:44:34.916371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:44:34.916371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:44:34.916371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:44:34.916371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:44:34.916371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:44:34.916371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:44:34.916371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: 47cd27ad4219485cae0d8d85a2823948 Jul 12 14:44:34.916371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-TestMinimumBasicScenario-923757968 Jul 12 14:44:34.916371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:44:34.916371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:44:34.919764 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/47cd27ad4219485cae0d8d85a2823948"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/47cd27ad4219485cae0d8d85a2823948"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/47cd27ad4219485cae0d8d85a2823948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_47cd27ad4219485cae0d8d85a2823948", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:44:34.919764 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-TestMinimumBasicScenario-923757968 Jul 12 14:44:34.919764 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: 47cd27ad4219485cae0d8d85a2823948 Jul 12 14:44:34.919764 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-TestMinimumBasicScenario-923757968 Jul 12 14:44:34.919764 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-TestMinimumBasicScenario-923757968-project Jul 12 14:44:34.919764 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:44:34.919764 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:44:34.919764 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: 92fed4b668e246f6b1b89a888c34f107 Jul 12 14:44:34.919764 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-TestMinimumBasicScenario-923757968-project Jul 12 14:44:34.919764 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: > Jul 12 14:44:34.919764 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Instance 84cf1792-70fc-4b57-a953-74848c1eb8ca is not attached to volume b75d8f04-6db7-457c-bdb6-ce7859f3aaf4 Jul 12 14:44:34.920470 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'server_id': '84cf1792-70fc-4b57-a953-74848c1eb8ca', 'id': 'b75d8f04-6db7-457c-bdb6-ce7859f3aaf4'} Jul 12 14:44:34.920470 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:44:34.920470 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:34.920470 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 12 14:44:34.920470 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 12 14:44:34.920470 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 14:44:34.920470 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 14:44:34.920470 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 12 14:44:34.920470 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 12 14:44:34.920470 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b75d8f04-6db7-457c-bdb6-ce7859f3aaf4. Jul 12 14:44:34.920470 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:44:34.920470 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:44:34.920470 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:44:34.920470 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:34.920470 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:44:34.920470 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:44:34.920470 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:44:34.920470 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:44:34.920470 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:44:34.921668 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:44:34.921668 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 12 14:44:34.921668 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 12 14:44:34.921668 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84cf1792-70fc-4b57-a953-74848c1eb8ca is not attached to volume b75d8f04-6db7-457c-bdb6-ce7859f3aaf4 Jul 12 14:44:34.921668 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:44:34.921668 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:44:34.921668 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:44:34.921668 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:34.921668 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:44:34.921668 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:44:34.921668 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:44:34.921668 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:44:34.921668 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84cf1792-70fc-4b57-a953-74848c1eb8ca is not attached to volume b75d8f04-6db7-457c-bdb6-ce7859f3aaf4 Jul 12 14:44:34.921668 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:44:34.921668 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c5830e21-a4db-44ee-b7e7-12b7bf549381 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Returning 404 to user: Instance 84cf1792-70fc-4b57-a953-74848c1eb8ca is not attached to volume b75d8f04-6db7-457c-bdb6-ce7859f3aaf4 {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:44:34.923155 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-c5830e21-a4db-44ee-b7e7-12b7bf549381 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "DELETE /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca/os-volume_attachments/b75d8f04-6db7-457c-bdb6-ce7859f3aaf4" status: 404 len: 154 microversion: 2.1 time: 0.102337 Jul 12 14:44:34.923155 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 323/645] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Jul 12 14:44:34 2022] DELETE /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca/os-volume_attachments/b75d8f04-6db7-457c-bdb6-ce7859f3aaf4 => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:44:35.631875 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-72fb879a-fbb5-4837-a084-693993002e4c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:35.632805 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-72fb879a-fbb5-4837-a084-693993002e4c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:35.639950 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-72fb879a-fbb5-4837-a084-693993002e4c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:35.640326 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-72fb879a-fbb5-4837-a084-693993002e4c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:35.641122 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-72fb879a-fbb5-4837-a084-693993002e4c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:35.642165 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-72fb879a-fbb5-4837-a084-693993002e4c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:35.703650 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-72fb879a-fbb5-4837-a084-693993002e4c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:35.712382 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-72fb879a-fbb5-4837-a084-693993002e4c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:35.713946 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-72fb879a-fbb5-4837-a084-693993002e4c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:35.715033 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-72fb879a-fbb5-4837-a084-693993002e4c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1285 microversion: 2.20 time: 0.087988 Jul 12 14:44:35.715610 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 323/646] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:44:35 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:44:36.220507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-5be1fc1f-ceff-4c4b-b0fa-655d488f2488 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:36.221002 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-5be1fc1f-ceff-4c4b-b0fa-655d488f2488 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:36.227986 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5be1fc1f-ceff-4c4b-b0fa-655d488f2488 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:36.228435 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5be1fc1f-ceff-4c4b-b0fa-655d488f2488 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:36.229249 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5be1fc1f-ceff-4c4b-b0fa-655d488f2488 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:36.229678 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5be1fc1f-ceff-4c4b-b0fa-655d488f2488 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:36.255871 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-5be1fc1f-ceff-4c4b-b0fa-655d488f2488 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Going to try to terminate instance {{(pid=129981) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:44:36.549893 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-5be1fc1f-ceff-4c4b-b0fa-655d488f2488 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "DELETE /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 204 len: 0 microversion: 2.1 time: 0.333661 Jul 12 14:44:36.550474 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 324/647] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Jul 12 14:44:36 2022] DELETE /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:44:36.558712 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ea69412a-6a49-44ad-ba25-d498219b9a89 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:36.559322 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-ea69412a-6a49-44ad-ba25-d498219b9a89 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:36.565548 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ea69412a-6a49-44ad-ba25-d498219b9a89 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:36.566270 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ea69412a-6a49-44ad-ba25-d498219b9a89 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:36.567074 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ea69412a-6a49-44ad-ba25-d498219b9a89 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:36.567515 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ea69412a-6a49-44ad-ba25-d498219b9a89 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:36.705025 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ea69412a-6a49-44ad-ba25-d498219b9a89 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:36.709046 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:36.714193 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ea69412a-6a49-44ad-ba25-d498219b9a89 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1551 microversion: 2.1 time: 0.159283 Jul 12 14:44:36.714854 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 324/648] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:36 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1551 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:36.734192 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-bd40d2cd-b55f-47a3-868d-97948582b186 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:36.735461 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-bd40d2cd-b55f-47a3-868d-97948582b186 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:36.741699 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bd40d2cd-b55f-47a3-868d-97948582b186 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:36.742156 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bd40d2cd-b55f-47a3-868d-97948582b186 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:36.742936 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bd40d2cd-b55f-47a3-868d-97948582b186 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:36.743372 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bd40d2cd-b55f-47a3-868d-97948582b186 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:36.806200 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-bd40d2cd-b55f-47a3-868d-97948582b186 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:36.815079 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-bd40d2cd-b55f-47a3-868d-97948582b186 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:36.816607 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-bd40d2cd-b55f-47a3-868d-97948582b186 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:36.818041 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-bd40d2cd-b55f-47a3-868d-97948582b186 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1333 microversion: 2.20 time: 0.088235 Jul 12 14:44:36.818603 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 325/649] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:44:36 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1333 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:44:37.731461 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-c0205692-6ddd-4384-b9c1-d76780adabf4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:37.732076 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-c0205692-6ddd-4384-b9c1-d76780adabf4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:37.739251 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c0205692-6ddd-4384-b9c1-d76780adabf4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:37.739708 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c0205692-6ddd-4384-b9c1-d76780adabf4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:37.740473 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c0205692-6ddd-4384-b9c1-d76780adabf4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:37.740916 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c0205692-6ddd-4384-b9c1-d76780adabf4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:37.835924 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d81e7d0f-b83b-416d-aab8-0095d065f306 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:37.836651 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-d81e7d0f-b83b-416d-aab8-0095d065f306 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:37.843403 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d81e7d0f-b83b-416d-aab8-0095d065f306 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:37.843927 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d81e7d0f-b83b-416d-aab8-0095d065f306 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:37.844789 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d81e7d0f-b83b-416d-aab8-0095d065f306 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:37.845329 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d81e7d0f-b83b-416d-aab8-0095d065f306 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:37.868203 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-c0205692-6ddd-4384-b9c1-d76780adabf4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:37.876495 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-c0205692-6ddd-4384-b9c1-d76780adabf4 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1551 microversion: 2.1 time: 0.148434 Jul 12 14:44:37.877061 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 325/650] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:37 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1551 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:37.907586 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d81e7d0f-b83b-416d-aab8-0095d065f306 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:37.915444 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d81e7d0f-b83b-416d-aab8-0095d065f306 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:37.916943 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d81e7d0f-b83b-416d-aab8-0095d065f306 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:37.918064 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-d81e7d0f-b83b-416d-aab8-0095d065f306 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1341 microversion: 2.20 time: 0.086037 Jul 12 14:44:37.918619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 326/651] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:44:37 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1341 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:44:38.429671 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-4f75d119-deab-4abf-b80c-08ba529e0cdd tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-429874062", "imageRef": "a66ccacb-7b1e-4f51-9eaf-069a356e0fdb", "flavorRef": "452"}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:44:38.477862 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.network.neutron [None req-4f75d119-deab-4abf-b80c-08ba529e0cdd tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] validate_networks() for None {{(pid=129980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:44:38.807300 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-4f75d119-deab-4abf-b80c-08ba529e0cdd tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Flavor limits 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:44:38.807870 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-4f75d119-deab-4abf-b80c-08ba529e0cdd tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Image limits 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:44:38.808173 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-4f75d119-deab-4abf-b80c-08ba529e0cdd tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Flavor pref 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:44:38.808770 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-4f75d119-deab-4abf-b80c-08ba529e0cdd tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Image pref 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:44:38.809237 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-4f75d119-deab-4abf-b80c-08ba529e0cdd tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:44:38.818412 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4f75d119-deab-4abf-b80c-08ba529e0cdd tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:38.818854 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4f75d119-deab-4abf-b80c-08ba529e0cdd tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:38.819678 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4f75d119-deab-4abf-b80c-08ba529e0cdd tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:38.820112 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4f75d119-deab-4abf-b80c-08ba529e0cdd tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:38.838175 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-4f75d119-deab-4abf-b80c-08ba529e0cdd tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Getting quotas for project f5e6f8aec4ba48789e2b40eb2196e73c. Resources: {'instances', 'cores', 'ram'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:44:38.842086 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-4f75d119-deab-4abf-b80c-08ba529e0cdd tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Getting quotas for user cbd982cea06a4e9ebecf3eee2590e8d8 and project f5e6f8aec4ba48789e2b40eb2196e73c. Resources: {'instances', 'cores', 'ram'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:44:38.852967 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-4f75d119-deab-4abf-b80c-08ba529e0cdd tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Going to run 1 instances... {{(pid=129980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:44:38.855093 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-4f75d119-deab-4abf-b80c-08ba529e0cdd tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] [instance: 908a1e75-facc-4a4c-b602-10be600c40a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a66ccacb-7b1e-4f51-9eaf-069a356e0fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:44:38.893707 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-96e0777e-2605-4992-9dff-cac932edda02 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:38.894309 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-96e0777e-2605-4992-9dff-cac932edda02 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:38.900751 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-96e0777e-2605-4992-9dff-cac932edda02 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:38.901326 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-96e0777e-2605-4992-9dff-cac932edda02 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:38.902015 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-96e0777e-2605-4992-9dff-cac932edda02 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:38.902440 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-96e0777e-2605-4992-9dff-cac932edda02 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:38.968637 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-4f75d119-deab-4abf-b80c-08ba529e0cdd tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.542480 Jul 12 14:44:38.969690 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 326/652] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Jul 12 14:44:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:44:38.974656 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-8dcac660-d46c-4f06-b76f-2c68b037404f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:38.975823 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-8dcac660-d46c-4f06-b76f-2c68b037404f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:38.989431 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8dcac660-d46c-4f06-b76f-2c68b037404f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:38.989892 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8dcac660-d46c-4f06-b76f-2c68b037404f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:38.990675 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8dcac660-d46c-4f06-b76f-2c68b037404f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:38.991118 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8dcac660-d46c-4f06-b76f-2c68b037404f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:39.090955 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-8dcac660-d46c-4f06-b76f-2c68b037404f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:39.100038 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-8dcac660-d46c-4f06-b76f-2c68b037404f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:39.101644 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-8dcac660-d46c-4f06-b76f-2c68b037404f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:39.102814 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-8dcac660-d46c-4f06-b76f-2c68b037404f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1341 microversion: 2.20 time: 0.132016 Jul 12 14:44:39.117477 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 327/653] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:44:38 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1341 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:44:39.117477 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-62e4228e-751c-4417-8364-7ea31608a9b8 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:39.117477 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-62e4228e-751c-4417-8364-7ea31608a9b8 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] [instance: 908a1e75-facc-4a4c-b602-10be600c40a3] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:39.132616 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-96e0777e-2605-4992-9dff-cac932edda02 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:39.141204 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-96e0777e-2605-4992-9dff-cac932edda02 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1551 microversion: 2.1 time: 0.251851 Jul 12 14:44:39.146300 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 327/654] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:38 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1551 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:44:39.194096 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-62e4228e-751c-4417-8364-7ea31608a9b8 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd982cea06a4e9ebecf3eee2590e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6f8aec4ba48789e2b40eb2196e73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:39.207266 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-62e4228e-751c-4417-8364-7ea31608a9b8 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] 10.222.0.30 "GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3" status: 200 len: 1214 microversion: 2.1 time: 0.097632 Jul 12 14:44:39.207951 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 328/655] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:39 2022] GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3 => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:39.978648 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-c5e393fb-fda7-4bd9-9ed9-ef2f461e373a req-152069ea-5928-4989-af64-cc98bafe6c06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84cf1792-70fc-4b57-a953-74848c1eb8ca", "name": "network-vif-deleted", "tag": "158072fd-c24f-4080-926d-9613cf2adbd5"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:44:39.997916 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-c5e393fb-fda7-4bd9-9ed9-ef2f461e373a req-152069ea-5928-4989-af64-cc98bafe6c06 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:40.000039 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-c5e393fb-fda7-4bd9-9ed9-ef2f461e373a req-152069ea-5928-4989-af64-cc98bafe6c06 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:40.012223 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-c5e393fb-fda7-4bd9-9ed9-ef2f461e373a req-152069ea-5928-4989-af64-cc98bafe6c06 service nova] Creating event network-vif-deleted:158072fd-c24f-4080-926d-9613cf2adbd5 for instance 84cf1792-70fc-4b57-a953-74848c1eb8ca on hv-cinder-82002 Jul 12 14:44:40.017677 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-c5e393fb-fda7-4bd9-9ed9-ef2f461e373a req-152069ea-5928-4989-af64-cc98bafe6c06 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042980 Jul 12 14:44:40.018373 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 328/656] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:44:40.124612 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-9935e79b-9923-4373-8ca0-cdf518317045 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:40.125309 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-9935e79b-9923-4373-8ca0-cdf518317045 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:40.133725 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9935e79b-9923-4373-8ca0-cdf518317045 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:40.134241 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9935e79b-9923-4373-8ca0-cdf518317045 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:40.135025 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9935e79b-9923-4373-8ca0-cdf518317045 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:40.135470 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9935e79b-9923-4373-8ca0-cdf518317045 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:40.167076 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-353cbec2-470a-4550-afd0-e2ea032d47c8 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:40.167849 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-353cbec2-470a-4550-afd0-e2ea032d47c8 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:40.176580 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-353cbec2-470a-4550-afd0-e2ea032d47c8 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:40.177140 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-353cbec2-470a-4550-afd0-e2ea032d47c8 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:40.178020 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-353cbec2-470a-4550-afd0-e2ea032d47c8 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:40.178530 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-353cbec2-470a-4550-afd0-e2ea032d47c8 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:40.448665 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-353cbec2-470a-4550-afd0-e2ea032d47c8 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fed4b668e246f6b1b89a888c34f107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cd27ad4219485cae0d8d85a2823948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:40.456500 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-353cbec2-470a-4550-afd0-e2ea032d47c8 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 200 len: 1509 microversion: 2.1 time: 0.293960 Jul 12 14:44:40.457587 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 329/657] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:40 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 1509 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:44:40.462359 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-5acffba4-f8c9-46ae-bf44-5f131b832cce tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:40.463341 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-5acffba4-f8c9-46ae-bf44-5f131b832cce tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] [instance: 908a1e75-facc-4a4c-b602-10be600c40a3] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:40.470762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5acffba4-f8c9-46ae-bf44-5f131b832cce tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:40.471332 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5acffba4-f8c9-46ae-bf44-5f131b832cce tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:40.472168 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5acffba4-f8c9-46ae-bf44-5f131b832cce tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:40.472667 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5acffba4-f8c9-46ae-bf44-5f131b832cce tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:40.561657 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-5acffba4-f8c9-46ae-bf44-5f131b832cce tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd982cea06a4e9ebecf3eee2590e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6f8aec4ba48789e2b40eb2196e73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:40.565843 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:40.570202 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-5acffba4-f8c9-46ae-bf44-5f131b832cce tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] 10.222.0.30 "GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3" status: 200 len: 1218 microversion: 2.1 time: 0.111353 Jul 12 14:44:40.570777 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 330/658] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:40 2022] GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3 => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:40.618023 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-9935e79b-9923-4373-8ca0-cdf518317045 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:40.627354 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-9935e79b-9923-4373-8ca0-cdf518317045 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:40.628872 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-9935e79b-9923-4373-8ca0-cdf518317045 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:40.630109 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-9935e79b-9923-4373-8ca0-cdf518317045 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1406 microversion: 2.20 time: 0.510095 Jul 12 14:44:40.630669 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 329/659] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:44:40 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1406 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:44:41.095110 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-5f330053-d10d-40cd-b14a-0e60c87768f3 req-a501bc4a-0f4f-488f-945c-cdb6b9bc671b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80951178-6d64-4856-a450-a1e1b64c2586", "tag": "46daa7fa-cab1-4811-a00f-fa4746971c05"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:44:41.127924 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-5f330053-d10d-40cd-b14a-0e60c87768f3 req-a501bc4a-0f4f-488f-945c-cdb6b9bc671b service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:41.128369 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-5f330053-d10d-40cd-b14a-0e60c87768f3 req-a501bc4a-0f4f-488f-945c-cdb6b9bc671b service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:41.145660 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-5f330053-d10d-40cd-b14a-0e60c87768f3 req-a501bc4a-0f4f-488f-945c-cdb6b9bc671b service nova] Creating event network-changed:46daa7fa-cab1-4811-a00f-fa4746971c05 for instance 80951178-6d64-4856-a450-a1e1b64c2586 on hv-cinder-82002 Jul 12 14:44:41.151344 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-5f330053-d10d-40cd-b14a-0e60c87768f3 req-a501bc4a-0f4f-488f-945c-cdb6b9bc671b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061120 Jul 12 14:44:41.152424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 331/660] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:44:41.475924 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-db5392c1-1466-4395-aa65-9c7b76c0637f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:41.476540 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-db5392c1-1466-4395-aa65-9c7b76c0637f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] [instance: 84cf1792-70fc-4b57-a953-74848c1eb8ca] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:41.482993 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-db5392c1-1466-4395-aa65-9c7b76c0637f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:41.483438 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-db5392c1-1466-4395-aa65-9c7b76c0637f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:41.484188 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-db5392c1-1466-4395-aa65-9c7b76c0637f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:41.484622 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-db5392c1-1466-4395-aa65-9c7b76c0637f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:41.497789 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.wsgi [None req-db5392c1-1466-4395-aa65-9c7b76c0637f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] HTTP exception thrown: Instance 84cf1792-70fc-4b57-a953-74848c1eb8ca could not be found. Jul 12 14:44:41.499727 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-db5392c1-1466-4395-aa65-9c7b76c0637f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Request method failure captured: Jul 12 14:44:41.499727 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: request: GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca HTTP/1.1 Jul 12 14:44:41.499727 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept: application/json Jul 12 14:44:41.499727 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept-Encoding: identity Jul 12 14:44:41.499727 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Connection: close Jul 12 14:44:41.499727 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Length: 0 Jul 12 14:44:41.499727 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Type: application/json Jul 12 14:44:41.499727 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Host: 10.222.0.30 Jul 12 14:44:41.499727 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Openstack-System-Scope: None Jul 12 14:44:41.499727 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: User-Agent: python-urllib3/1.26.9 Jul 12 14:44:41.499727 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Auth-Token: gAAAAABizYfzD0fQFnuJ1n9dVeirw6UMGVn1GYaEEALPoUetW2V5EKJ3UNuOn0oWMEyFN0hh34C8QT8gvcWyoZgIxXQ4UkyCHnqKT3eaEf03skmvHbuNWQ6OAMDHcjKQD5LP87iGJofs8hAf_jGO6LqSqlFqhvhDwmZoot8gmN8ttHEtNmYLQVY Jul 12 14:44:41.499727 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Id: None Jul 12 14:44:41.499727 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Name: None Jul 12 14:44:41.499727 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Identity-Status: Confirmed Jul 12 14:44:41.499727 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Is-Admin-Project: True Jul 12 14:44:41.499727 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Id: default Jul 12 14:44:41.499727 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Name: Default Jul 12 14:44:41.499727 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Id: 47cd27ad4219485cae0d8d85a2823948 Jul 12 14:44:41.499727 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Name: tempest-TestMinimumBasicScenario-923757968 Jul 12 14:44:41.499727 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Role: member,reader Jul 12 14:44:41.499727 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Roles: member,reader Jul 12 14:44:41.503406 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/47cd27ad4219485cae0d8d85a2823948"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/47cd27ad4219485cae0d8d85a2823948"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/47cd27ad4219485cae0d8d85a2823948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_47cd27ad4219485cae0d8d85a2823948", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:44:41.503406 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant: tempest-TestMinimumBasicScenario-923757968 Jul 12 14:44:41.503406 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Id: 47cd27ad4219485cae0d8d85a2823948 Jul 12 14:44:41.503406 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Name: tempest-TestMinimumBasicScenario-923757968 Jul 12 14:44:41.503406 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User: tempest-TestMinimumBasicScenario-923757968-project Jul 12 14:44:41.503406 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Id: default Jul 12 14:44:41.503406 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Name: Default Jul 12 14:44:41.503406 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Id: 92fed4b668e246f6b1b89a888c34f107 Jul 12 14:44:41.503406 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Name: tempest-TestMinimumBasicScenario-923757968-project Jul 12 14:44:41.503406 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: method: > Jul 12 14:44:41.503406 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: exception: Instance 84cf1792-70fc-4b57-a953-74848c1eb8ca could not be found. Jul 12 14:44:41.503406 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: action_args: {'id': '84cf1792-70fc-4b57-a953-74848c1eb8ca'} Jul 12 14:44:41.504277 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:44:41.504277 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:41.504277 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:44:41.504277 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:44:41.504277 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:44:41.504277 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:44:41.504277 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:44:41.504277 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:44:41.504277 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:44:41.504277 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:44:41.504277 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84cf1792-70fc-4b57-a953-74848c1eb8ca could not be found. Jul 12 14:44:41.504277 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:44:41.504277 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:44:41.504277 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:44:41.504277 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:41.504277 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:44:41.504277 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:44:41.504277 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:44:41.504277 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:44:41.504277 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:44:41.505975 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:44:41.505975 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:44:41.505975 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:44:41.505975 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:44:41.505975 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:44:41.505975 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:44:41.505975 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:44:41.505975 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84cf1792-70fc-4b57-a953-74848c1eb8ca could not be found. Jul 12 14:44:41.505975 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:44:41.505975 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:44:41.505975 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:44:41.505975 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:41.505975 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:44:41.505975 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:44:41.505975 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:44:41.505975 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:44:41.505975 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84cf1792-70fc-4b57-a953-74848c1eb8ca could not be found. Jul 12 14:44:41.505975 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:44:41.507353 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-db5392c1-1466-4395-aa65-9c7b76c0637f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Returning 404 to user: Instance 84cf1792-70fc-4b57-a953-74848c1eb8ca could not be found. {{(pid=129980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:44:41.507353 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-db5392c1-1466-4395-aa65-9c7b76c0637f tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca" status: 404 len: 111 microversion: 2.1 time: 0.029949 Jul 12 14:44:41.507353 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 330/661] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:41 2022] GET /compute/v2.1/servers/84cf1792-70fc-4b57-a953-74848c1eb8ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:44:41.510754 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-37a6c5d1-203b-4d39-9353-db7dc7f3ba40 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] Calling method '.version_select at 0x7f962c88cca0>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:41.580815 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-37a6c5d1-203b-4d39-9353-db7dc7f3ba40 tempest-TestMinimumBasicScenario-923757968 tempest-TestMinimumBasicScenario-923757968-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-186415476" status: 202 len: 0 microversion: 2.1 time: 0.074168 Jul 12 14:44:41.581436 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 332/662] 10.222.0.30 () {58 vars in 1268 bytes} [Tue Jul 12 14:44:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-186415476 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:44:41.587512 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-bd836616-6612-4037-a1ea-8dc302eae548 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:41.588150 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-bd836616-6612-4037-a1ea-8dc302eae548 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] [instance: 908a1e75-facc-4a4c-b602-10be600c40a3] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:41.599268 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bd836616-6612-4037-a1ea-8dc302eae548 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:41.599671 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bd836616-6612-4037-a1ea-8dc302eae548 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:41.600468 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bd836616-6612-4037-a1ea-8dc302eae548 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:41.600978 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bd836616-6612-4037-a1ea-8dc302eae548 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:41.650079 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c047f505-cc4a-429d-ac80-93bfc5b34c25 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:41.651310 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-c047f505-cc4a-429d-ac80-93bfc5b34c25 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:41.660375 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c047f505-cc4a-429d-ac80-93bfc5b34c25 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:41.662558 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c047f505-cc4a-429d-ac80-93bfc5b34c25 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:41.662558 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c047f505-cc4a-429d-ac80-93bfc5b34c25 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:41.662558 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c047f505-cc4a-429d-ac80-93bfc5b34c25 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:41.706089 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-bd836616-6612-4037-a1ea-8dc302eae548 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd982cea06a4e9ebecf3eee2590e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6f8aec4ba48789e2b40eb2196e73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:41.715187 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-bd836616-6612-4037-a1ea-8dc302eae548 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] 10.222.0.30 "GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3" status: 200 len: 1266 microversion: 2.1 time: 0.131786 Jul 12 14:44:41.716711 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 331/663] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:41 2022] GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3 => generated 1266 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:41.868453 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c047f505-cc4a-429d-ac80-93bfc5b34c25 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:41.877652 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c047f505-cc4a-429d-ac80-93bfc5b34c25 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:41.879133 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c047f505-cc4a-429d-ac80-93bfc5b34c25 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:41.880227 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-c047f505-cc4a-429d-ac80-93bfc5b34c25 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1406 microversion: 2.20 time: 0.234140 Jul 12 14:44:41.880771 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 333/664] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:44:41 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:44:42.733089 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-1d5fe954-839d-4717-98f8-94f6ec73a0ed tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:42.733735 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-1d5fe954-839d-4717-98f8-94f6ec73a0ed tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] [instance: 908a1e75-facc-4a4c-b602-10be600c40a3] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:42.740261 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1d5fe954-839d-4717-98f8-94f6ec73a0ed tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:42.740962 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1d5fe954-839d-4717-98f8-94f6ec73a0ed tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:42.741767 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1d5fe954-839d-4717-98f8-94f6ec73a0ed tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:42.742209 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1d5fe954-839d-4717-98f8-94f6ec73a0ed tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:42.807713 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-1d5fe954-839d-4717-98f8-94f6ec73a0ed tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd982cea06a4e9ebecf3eee2590e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6f8aec4ba48789e2b40eb2196e73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:42.815193 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-1d5fe954-839d-4717-98f8-94f6ec73a0ed tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] 10.222.0.30 "GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3" status: 200 len: 1272 microversion: 2.1 time: 0.085877 Jul 12 14:44:42.815774 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 332/665] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:42 2022] GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3 => generated 1272 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:42.897424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-a8d767ef-d8ce-4dfa-ab6f-297321c52717 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:42.898012 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-a8d767ef-d8ce-4dfa-ab6f-297321c52717 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:42.904586 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a8d767ef-d8ce-4dfa-ab6f-297321c52717 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:42.905034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a8d767ef-d8ce-4dfa-ab6f-297321c52717 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:42.905840 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a8d767ef-d8ce-4dfa-ab6f-297321c52717 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:42.906266 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a8d767ef-d8ce-4dfa-ab6f-297321c52717 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:43.043635 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-a8d767ef-d8ce-4dfa-ab6f-297321c52717 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:43.051825 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-a8d767ef-d8ce-4dfa-ab6f-297321c52717 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:43.065430 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-a8d767ef-d8ce-4dfa-ab6f-297321c52717 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:43.065430 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-a8d767ef-d8ce-4dfa-ab6f-297321c52717 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1406 microversion: 2.20 time: 0.161221 Jul 12 14:44:43.065430 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 334/666] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:44:42 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:44:43.833735 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-e9a4bc1c-4234-4d6e-96bd-44e1960aba1f tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:43.835028 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-e9a4bc1c-4234-4d6e-96bd-44e1960aba1f tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] [instance: 908a1e75-facc-4a4c-b602-10be600c40a3] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:43.841778 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e9a4bc1c-4234-4d6e-96bd-44e1960aba1f tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:43.842149 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e9a4bc1c-4234-4d6e-96bd-44e1960aba1f tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:43.842919 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e9a4bc1c-4234-4d6e-96bd-44e1960aba1f tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:43.843495 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e9a4bc1c-4234-4d6e-96bd-44e1960aba1f tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:44.008418 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-e9a4bc1c-4234-4d6e-96bd-44e1960aba1f tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd982cea06a4e9ebecf3eee2590e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6f8aec4ba48789e2b40eb2196e73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:44.016031 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-e9a4bc1c-4234-4d6e-96bd-44e1960aba1f tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] 10.222.0.30 "GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3" status: 200 len: 1314 microversion: 2.1 time: 0.187012 Jul 12 14:44:44.017226 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 333/667] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:43 2022] GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:44.081691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-9d10a267-ef17-4558-98bc-f39947f62f58 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:44.082373 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-9d10a267-ef17-4558-98bc-f39947f62f58 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:44.093478 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9d10a267-ef17-4558-98bc-f39947f62f58 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:44.094173 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9d10a267-ef17-4558-98bc-f39947f62f58 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:44.095249 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9d10a267-ef17-4558-98bc-f39947f62f58 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:44.095609 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9d10a267-ef17-4558-98bc-f39947f62f58 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:44.334761 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-9d10a267-ef17-4558-98bc-f39947f62f58 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:44.351058 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-9d10a267-ef17-4558-98bc-f39947f62f58 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:44.351058 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-9d10a267-ef17-4558-98bc-f39947f62f58 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:44.351058 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-9d10a267-ef17-4558-98bc-f39947f62f58 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1406 microversion: 2.20 time: 0.275488 Jul 12 14:44:44.357582 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 335/668] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:44:44 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1406 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:44:44.386556 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-949ec0fa-b209-4005-9f3e-93675ec7d847 req-af8f3b3f-3356-4656-a78d-f395072ae93d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "908a1e75-facc-4a4c-b602-10be600c40a3", "tag": "4a5ec398-b2ae-4b98-9376-8ce6519452c5"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:44:44.406761 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-949ec0fa-b209-4005-9f3e-93675ec7d847 req-af8f3b3f-3356-4656-a78d-f395072ae93d service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:44.407247 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-949ec0fa-b209-4005-9f3e-93675ec7d847 req-af8f3b3f-3356-4656-a78d-f395072ae93d service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:44.425665 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-949ec0fa-b209-4005-9f3e-93675ec7d847 req-af8f3b3f-3356-4656-a78d-f395072ae93d service nova] Creating event network-changed:4a5ec398-b2ae-4b98-9376-8ce6519452c5 for instance 908a1e75-facc-4a4c-b602-10be600c40a3 on hv-cinder-82002 Jul 12 14:44:44.433855 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-949ec0fa-b209-4005-9f3e-93675ec7d847 req-af8f3b3f-3356-4656-a78d-f395072ae93d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052337 Jul 12 14:44:44.435847 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 334/669] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:44:45.034273 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e56ccf7c-b9b7-4116-bf4e-44363e7826cb tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:45.035303 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-e56ccf7c-b9b7-4116-bf4e-44363e7826cb tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] [instance: 908a1e75-facc-4a4c-b602-10be600c40a3] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:45.041804 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell0:SELECT=2 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:45.047276 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e56ccf7c-b9b7-4116-bf4e-44363e7826cb tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:45.047944 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e56ccf7c-b9b7-4116-bf4e-44363e7826cb tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:45.048922 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e56ccf7c-b9b7-4116-bf4e-44363e7826cb tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:45.049580 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e56ccf7c-b9b7-4116-bf4e-44363e7826cb tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:45.366816 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-3ebd7c3f-11d1-4850-b8e6-322a6d6185d6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:45.369192 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-3ebd7c3f-11d1-4850-b8e6-322a6d6185d6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:45.396434 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3ebd7c3f-11d1-4850-b8e6-322a6d6185d6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:45.397822 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3ebd7c3f-11d1-4850-b8e6-322a6d6185d6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:45.398781 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3ebd7c3f-11d1-4850-b8e6-322a6d6185d6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:45.399369 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3ebd7c3f-11d1-4850-b8e6-322a6d6185d6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:45.573649 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e56ccf7c-b9b7-4116-bf4e-44363e7826cb tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd982cea06a4e9ebecf3eee2590e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6f8aec4ba48789e2b40eb2196e73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:45.590104 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-e56ccf7c-b9b7-4116-bf4e-44363e7826cb tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] 10.222.0.30 "GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3" status: 200 len: 1314 microversion: 2.1 time: 0.559997 Jul 12 14:44:45.602351 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 336/670] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:45 2022] GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3 => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:45.610281 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-3ebd7c3f-11d1-4850-b8e6-322a6d6185d6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:45.620226 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-3ebd7c3f-11d1-4850-b8e6-322a6d6185d6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:45.623401 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-3ebd7c3f-11d1-4850-b8e6-322a6d6185d6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:45.624662 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-3ebd7c3f-11d1-4850-b8e6-322a6d6185d6 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1406 microversion: 2.20 time: 0.263680 Jul 12 14:44:45.632660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 335/671] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:44:45 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1406 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:44:46.608584 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-bd5a1db5-20b3-4b23-b27a-26dc62230b74 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:46.609289 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-bd5a1db5-20b3-4b23-b27a-26dc62230b74 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] [instance: 908a1e75-facc-4a4c-b602-10be600c40a3] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:46.616509 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bd5a1db5-20b3-4b23-b27a-26dc62230b74 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:46.616962 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bd5a1db5-20b3-4b23-b27a-26dc62230b74 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:46.617770 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bd5a1db5-20b3-4b23-b27a-26dc62230b74 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:46.618355 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bd5a1db5-20b3-4b23-b27a-26dc62230b74 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:46.644407 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-58224808-7469-4c91-a79e-7270a5dbad2b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:46.645038 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-58224808-7469-4c91-a79e-7270a5dbad2b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:46.656093 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-58224808-7469-4c91-a79e-7270a5dbad2b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:46.656550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-58224808-7469-4c91-a79e-7270a5dbad2b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:46.657362 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-58224808-7469-4c91-a79e-7270a5dbad2b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:46.658057 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-58224808-7469-4c91-a79e-7270a5dbad2b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:46.869798 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-bd5a1db5-20b3-4b23-b27a-26dc62230b74 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd982cea06a4e9ebecf3eee2590e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6f8aec4ba48789e2b40eb2196e73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:46.881083 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-58224808-7469-4c91-a79e-7270a5dbad2b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:46.884647 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-bd5a1db5-20b3-4b23-b27a-26dc62230b74 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] 10.222.0.30 "GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3" status: 200 len: 1314 microversion: 2.1 time: 0.273492 Jul 12 14:44:46.885306 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 337/672] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:46 2022] GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:46.889511 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-58224808-7469-4c91-a79e-7270a5dbad2b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:46.892324 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-58224808-7469-4c91-a79e-7270a5dbad2b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:46.892887 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-58224808-7469-4c91-a79e-7270a5dbad2b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1406 microversion: 2.20 time: 0.252717 Jul 12 14:44:46.893470 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 336/673] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:44:46 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:44:47.725457 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-aeb81ba6-256c-4dc3-adfd-34e56a7e438b req-546c31b5-fc70-4cbb-84bb-57d44a72c11f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80951178-6d64-4856-a450-a1e1b64c2586", "name": "network-vif-plugged", "status": "completed", "tag": "46daa7fa-cab1-4811-a00f-fa4746971c05"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:44:47.735196 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-aeb81ba6-256c-4dc3-adfd-34e56a7e438b req-546c31b5-fc70-4cbb-84bb-57d44a72c11f service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:47.735725 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-aeb81ba6-256c-4dc3-adfd-34e56a7e438b req-546c31b5-fc70-4cbb-84bb-57d44a72c11f service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:47.750261 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-aeb81ba6-256c-4dc3-adfd-34e56a7e438b req-546c31b5-fc70-4cbb-84bb-57d44a72c11f service nova] Creating event network-vif-plugged:46daa7fa-cab1-4811-a00f-fa4746971c05 for instance 80951178-6d64-4856-a450-a1e1b64c2586 on hv-cinder-82002 Jul 12 14:44:47.756887 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-aeb81ba6-256c-4dc3-adfd-34e56a7e438b req-546c31b5-fc70-4cbb-84bb-57d44a72c11f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034615 Jul 12 14:44:47.757867 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 338/674] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:44:47.900925 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-40816663-7d5f-4dbb-b85c-45cbbe24393a tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:47.901625 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-40816663-7d5f-4dbb-b85c-45cbbe24393a tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] [instance: 908a1e75-facc-4a4c-b602-10be600c40a3] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:47.908794 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-40816663-7d5f-4dbb-b85c-45cbbe24393a tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:47.909276 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-40816663-7d5f-4dbb-b85c-45cbbe24393a tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:47.910058 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-40816663-7d5f-4dbb-b85c-45cbbe24393a tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:47.910500 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-40816663-7d5f-4dbb-b85c-45cbbe24393a tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:47.911186 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e4acb2f1-1459-472a-8cb6-a22868023c9d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:47.911972 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-e4acb2f1-1459-472a-8cb6-a22868023c9d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:47.919442 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e4acb2f1-1459-472a-8cb6-a22868023c9d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:47.925379 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e4acb2f1-1459-472a-8cb6-a22868023c9d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:47.925379 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e4acb2f1-1459-472a-8cb6-a22868023c9d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:47.925379 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e4acb2f1-1459-472a-8cb6-a22868023c9d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:48.218710 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-40816663-7d5f-4dbb-b85c-45cbbe24393a tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd982cea06a4e9ebecf3eee2590e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6f8aec4ba48789e2b40eb2196e73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:48.226656 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-40816663-7d5f-4dbb-b85c-45cbbe24393a tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] 10.222.0.30 "GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3" status: 200 len: 1314 microversion: 2.1 time: 0.329663 Jul 12 14:44:48.236894 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 337/675] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:47 2022] GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:48.243655 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e4acb2f1-1459-472a-8cb6-a22868023c9d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:48.254697 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e4acb2f1-1459-472a-8cb6-a22868023c9d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:48.256204 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e4acb2f1-1459-472a-8cb6-a22868023c9d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:48.257608 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-e4acb2f1-1459-472a-8cb6-a22868023c9d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1406 microversion: 2.20 time: 0.350870 Jul 12 14:44:48.258317 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 339/676] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:44:47 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1406 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:44:49.244110 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-3ef83505-71a9-4722-a67c-13bf7fa52d99 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:49.244782 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-3ef83505-71a9-4722-a67c-13bf7fa52d99 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] [instance: 908a1e75-facc-4a4c-b602-10be600c40a3] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:49.248406 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell0:SELECT=4 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:49.249843 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell0:SELECT=18 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:49.254140 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3ef83505-71a9-4722-a67c-13bf7fa52d99 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:49.254789 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3ef83505-71a9-4722-a67c-13bf7fa52d99 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:49.255647 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3ef83505-71a9-4722-a67c-13bf7fa52d99 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:49.256275 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3ef83505-71a9-4722-a67c-13bf7fa52d99 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:49.277237 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-13225404-0930-48cc-92ab-154c8e22de37 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:49.278471 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-13225404-0930-48cc-92ab-154c8e22de37 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:49.286157 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-13225404-0930-48cc-92ab-154c8e22de37 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:49.286863 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-13225404-0930-48cc-92ab-154c8e22de37 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:49.288318 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-13225404-0930-48cc-92ab-154c8e22de37 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:49.288942 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-13225404-0930-48cc-92ab-154c8e22de37 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:49.534324 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-3ef83505-71a9-4722-a67c-13bf7fa52d99 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd982cea06a4e9ebecf3eee2590e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6f8aec4ba48789e2b40eb2196e73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:49.544502 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-3ef83505-71a9-4722-a67c-13bf7fa52d99 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] 10.222.0.30 "GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3" status: 200 len: 1314 microversion: 2.1 time: 0.304215 Jul 12 14:44:49.545242 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 338/677] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:49 2022] GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:49.592969 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-13225404-0930-48cc-92ab-154c8e22de37 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:49.601842 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-13225404-0930-48cc-92ab-154c8e22de37 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:49.605395 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-13225404-0930-48cc-92ab-154c8e22de37 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:49.607635 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-13225404-0930-48cc-92ab-154c8e22de37 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1406 microversion: 2.20 time: 0.334860 Jul 12 14:44:49.618521 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 340/678] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:44:49 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1406 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:44:49.775800 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-4f20b902-8e94-4df6-b440-6cbb7897a04a req-965630ec-ecef-4fca-859f-d6c38e09b039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "908a1e75-facc-4a4c-b602-10be600c40a3", "name": "network-vif-plugged", "status": "completed", "tag": "4a5ec398-b2ae-4b98-9376-8ce6519452c5"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:44:49.784859 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-4f20b902-8e94-4df6-b440-6cbb7897a04a req-965630ec-ecef-4fca-859f-d6c38e09b039 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:49.785426 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-4f20b902-8e94-4df6-b440-6cbb7897a04a req-965630ec-ecef-4fca-859f-d6c38e09b039 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:49.798582 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-4f20b902-8e94-4df6-b440-6cbb7897a04a req-965630ec-ecef-4fca-859f-d6c38e09b039 service nova] Creating event network-vif-plugged:4a5ec398-b2ae-4b98-9376-8ce6519452c5 for instance 908a1e75-facc-4a4c-b602-10be600c40a3 on hv-cinder-82002 Jul 12 14:44:49.803606 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-4f20b902-8e94-4df6-b440-6cbb7897a04a req-965630ec-ecef-4fca-859f-d6c38e09b039 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031717 Jul 12 14:44:49.804284 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 339/679] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:44:50.564579 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-aab297df-315e-4b64-9f37-9d77bd6d324f tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:50.565826 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-aab297df-315e-4b64-9f37-9d77bd6d324f tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] [instance: 908a1e75-facc-4a4c-b602-10be600c40a3] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:50.577106 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-aab297df-315e-4b64-9f37-9d77bd6d324f tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:50.577947 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-aab297df-315e-4b64-9f37-9d77bd6d324f tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:50.579969 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-aab297df-315e-4b64-9f37-9d77bd6d324f tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:50.581094 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-aab297df-315e-4b64-9f37-9d77bd6d324f tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:50.629329 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-dfebbee5-df9c-4ad4-8bbe-21d66dbd3c87 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:50.630676 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-dfebbee5-df9c-4ad4-8bbe-21d66dbd3c87 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:50.639619 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-dfebbee5-df9c-4ad4-8bbe-21d66dbd3c87 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:50.640320 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-dfebbee5-df9c-4ad4-8bbe-21d66dbd3c87 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:50.641905 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-dfebbee5-df9c-4ad4-8bbe-21d66dbd3c87 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:50.642582 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-dfebbee5-df9c-4ad4-8bbe-21d66dbd3c87 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:50.846725 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-aab297df-315e-4b64-9f37-9d77bd6d324f tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd982cea06a4e9ebecf3eee2590e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6f8aec4ba48789e2b40eb2196e73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:50.853495 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-dfebbee5-df9c-4ad4-8bbe-21d66dbd3c87 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:50.854247 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-aab297df-315e-4b64-9f37-9d77bd6d324f tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] 10.222.0.30 "GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3" status: 200 len: 1314 microversion: 2.1 time: 0.296190 Jul 12 14:44:50.854815 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 341/680] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:50 2022] GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:50.862081 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-dfebbee5-df9c-4ad4-8bbe-21d66dbd3c87 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:50.863908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-dfebbee5-df9c-4ad4-8bbe-21d66dbd3c87 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:50.865148 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-dfebbee5-df9c-4ad4-8bbe-21d66dbd3c87 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1597 microversion: 2.20 time: 0.242735 Jul 12 14:44:50.866064 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 340/681] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:44:50 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1597 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:44:50.889700 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-b2514084-e9b1-4eff-a18f-4f35505512e2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:50.890428 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-b2514084-e9b1-4eff-a18f-4f35505512e2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:50.909655 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b2514084-e9b1-4eff-a18f-4f35505512e2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:50.909655 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b2514084-e9b1-4eff-a18f-4f35505512e2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:50.910127 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b2514084-e9b1-4eff-a18f-4f35505512e2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:50.910520 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b2514084-e9b1-4eff-a18f-4f35505512e2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:51.037754 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-b2514084-e9b1-4eff-a18f-4f35505512e2 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.151799 Jul 12 14:44:51.038538 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 342/682] 10.222.0.30 () {60 vars in 1315 bytes} [Tue Jul 12 14:44:50 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:44:51.871083 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-b2bccb72-e482-4664-8f17-b3f9a3894259 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:51.871616 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-b2bccb72-e482-4664-8f17-b3f9a3894259 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] [instance: 908a1e75-facc-4a4c-b602-10be600c40a3] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:51.878830 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b2bccb72-e482-4664-8f17-b3f9a3894259 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:51.879293 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b2bccb72-e482-4664-8f17-b3f9a3894259 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:51.880073 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b2bccb72-e482-4664-8f17-b3f9a3894259 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:51.880516 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b2bccb72-e482-4664-8f17-b3f9a3894259 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:52.053039 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-b2bccb72-e482-4664-8f17-b3f9a3894259 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd982cea06a4e9ebecf3eee2590e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6f8aec4ba48789e2b40eb2196e73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:52.061176 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-b2bccb72-e482-4664-8f17-b3f9a3894259 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] 10.222.0.30 "GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3" status: 200 len: 1314 microversion: 2.1 time: 0.193968 Jul 12 14:44:52.062184 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 341/683] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:51 2022] GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:52.285943 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-326b3117-2002-4c1b-b058-f1be57d22ed6 req-425f0956-3513-493c-b2fb-4a5a1e807638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80951178-6d64-4856-a450-a1e1b64c2586", "tag": "46daa7fa-cab1-4811-a00f-fa4746971c05"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:44:52.295068 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-326b3117-2002-4c1b-b058-f1be57d22ed6 req-425f0956-3513-493c-b2fb-4a5a1e807638 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:52.295522 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-326b3117-2002-4c1b-b058-f1be57d22ed6 req-425f0956-3513-493c-b2fb-4a5a1e807638 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:52.310787 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-326b3117-2002-4c1b-b058-f1be57d22ed6 req-425f0956-3513-493c-b2fb-4a5a1e807638 service nova] Creating event network-changed:46daa7fa-cab1-4811-a00f-fa4746971c05 for instance 80951178-6d64-4856-a450-a1e1b64c2586 on hv-cinder-82002 Jul 12 14:44:52.316551 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-326b3117-2002-4c1b-b058-f1be57d22ed6 req-425f0956-3513-493c-b2fb-4a5a1e807638 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.238335 Jul 12 14:44:52.317189 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 343/684] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:44:53.078712 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-12430e82-22b2-44b3-afe0-392ca25d3d8c tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:53.079936 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-12430e82-22b2-44b3-afe0-392ca25d3d8c tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] [instance: 908a1e75-facc-4a4c-b602-10be600c40a3] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:53.086937 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-12430e82-22b2-44b3-afe0-392ca25d3d8c tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:53.087385 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-12430e82-22b2-44b3-afe0-392ca25d3d8c tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:53.089723 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-12430e82-22b2-44b3-afe0-392ca25d3d8c tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:53.089723 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-12430e82-22b2-44b3-afe0-392ca25d3d8c tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:53.253597 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-12430e82-22b2-44b3-afe0-392ca25d3d8c tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd982cea06a4e9ebecf3eee2590e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6f8aec4ba48789e2b40eb2196e73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:53.261522 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-12430e82-22b2-44b3-afe0-392ca25d3d8c tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] 10.222.0.30 "GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3" status: 200 len: 1464 microversion: 2.1 time: 0.186638 Jul 12 14:44:53.262098 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 342/685] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:53 2022] GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3 => generated 1464 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:53.312005 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d9f8b91d-3d48-4fc1-88ec-183dc9322d5c tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:53.312588 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-d9f8b91d-3d48-4fc1-88ec-183dc9322d5c tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] [instance: 908a1e75-facc-4a4c-b602-10be600c40a3] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:53.319138 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d9f8b91d-3d48-4fc1-88ec-183dc9322d5c tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:53.319585 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d9f8b91d-3d48-4fc1-88ec-183dc9322d5c tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:53.320862 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d9f8b91d-3d48-4fc1-88ec-183dc9322d5c tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:53.321388 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d9f8b91d-3d48-4fc1-88ec-183dc9322d5c tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:53.348516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-d9f8b91d-3d48-4fc1-88ec-183dc9322d5c tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] [instance: 908a1e75-facc-4a4c-b602-10be600c40a3] Going to try to terminate instance {{(pid=129981) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:44:53.682466 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-d9f8b91d-3d48-4fc1-88ec-183dc9322d5c tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] 10.222.0.30 "DELETE /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3" status: 204 len: 0 microversion: 2.1 time: 0.374936 Jul 12 14:44:53.682978 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 344/686] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Jul 12 14:44:53 2022] DELETE /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:44:53.691821 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-c94c19bf-17b9-4bcf-8aea-4398e2203072 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:53.692441 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-c94c19bf-17b9-4bcf-8aea-4398e2203072 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] [instance: 908a1e75-facc-4a4c-b602-10be600c40a3] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:53.698811 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c94c19bf-17b9-4bcf-8aea-4398e2203072 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:53.702865 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c94c19bf-17b9-4bcf-8aea-4398e2203072 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:53.702865 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c94c19bf-17b9-4bcf-8aea-4398e2203072 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:53.702865 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c94c19bf-17b9-4bcf-8aea-4398e2203072 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:53.829515 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-c94c19bf-17b9-4bcf-8aea-4398e2203072 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd982cea06a4e9ebecf3eee2590e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6f8aec4ba48789e2b40eb2196e73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:53.836276 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-c94c19bf-17b9-4bcf-8aea-4398e2203072 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] 10.222.0.30 "GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3" status: 200 len: 1470 microversion: 2.1 time: 0.149084 Jul 12 14:44:53.836835 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 343/687] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:53 2022] GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3 => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:44:54.855597 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d2698ce6-2bd0-4422-b54f-6c509d5a022a tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:54.856211 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-d2698ce6-2bd0-4422-b54f-6c509d5a022a tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] [instance: 908a1e75-facc-4a4c-b602-10be600c40a3] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:54.864247 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d2698ce6-2bd0-4422-b54f-6c509d5a022a tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:54.864818 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d2698ce6-2bd0-4422-b54f-6c509d5a022a tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:54.865938 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d2698ce6-2bd0-4422-b54f-6c509d5a022a tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:54.867256 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d2698ce6-2bd0-4422-b54f-6c509d5a022a tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:54.950913 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-d61fbf9b-6647-412a-9f15-0cc78bed8273 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:54.951428 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-d61fbf9b-6647-412a-9f15-0cc78bed8273 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:54.961322 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d61fbf9b-6647-412a-9f15-0cc78bed8273 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:54.961322 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d61fbf9b-6647-412a-9f15-0cc78bed8273 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:54.961694 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d61fbf9b-6647-412a-9f15-0cc78bed8273 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:54.962313 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d61fbf9b-6647-412a-9f15-0cc78bed8273 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:55.017609 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d2698ce6-2bd0-4422-b54f-6c509d5a022a tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd982cea06a4e9ebecf3eee2590e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6f8aec4ba48789e2b40eb2196e73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:55.025699 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-d2698ce6-2bd0-4422-b54f-6c509d5a022a tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] 10.222.0.30 "GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3" status: 200 len: 1470 microversion: 2.1 time: 0.175417 Jul 12 14:44:55.026369 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 345/688] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:54 2022] GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3 => generated 1470 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:55.095972 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.objects.instance [None req-d61fbf9b-6647-412a-9f15-0cc78bed8273 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lazy-loading 'services' on Instance uuid 8a9deddf-4864-4ad7-9f64-51b96f7c45eb {{(pid=129980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:44:55.135466 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=100 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:55.337807 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-d61fbf9b-6647-412a-9f15-0cc78bed8273 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb/os-volume_attachments/68b1884c-54d0-412f-8946-a28baead197e" status: 202 len: 0 microversion: 2.1 time: 0.393110 Jul 12 14:44:55.338398 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 344/689] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Jul 12 14:44:54 2022] DELETE /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb/os-volume_attachments/68b1884c-54d0-412f-8946-a28baead197e => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:44:55.347218 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-81e753ac-6caa-4e7c-bc5f-3be89e6ff9d6 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:55.348148 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-81e753ac-6caa-4e7c-bc5f-3be89e6ff9d6 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:55.354384 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-81e753ac-6caa-4e7c-bc5f-3be89e6ff9d6 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:55.354838 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-81e753ac-6caa-4e7c-bc5f-3be89e6ff9d6 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:55.355612 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-81e753ac-6caa-4e7c-bc5f-3be89e6ff9d6 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:55.356051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-81e753ac-6caa-4e7c-bc5f-3be89e6ff9d6 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:55.393358 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-81e753ac-6caa-4e7c-bc5f-3be89e6ff9d6 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050533 Jul 12 14:44:55.393930 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 346/690] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Jul 12 14:44:55 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:44:55.898008 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-4b56b39d-4976-4c49-a37c-3364905de732 req-22a95ff0-2e04-44d0-84f3-3a1fccb0bcc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "908a1e75-facc-4a4c-b602-10be600c40a3", "name": "network-vif-deleted", "tag": "4a5ec398-b2ae-4b98-9376-8ce6519452c5"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:44:55.908169 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-4b56b39d-4976-4c49-a37c-3364905de732 req-22a95ff0-2e04-44d0-84f3-3a1fccb0bcc6 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:55.908720 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-4b56b39d-4976-4c49-a37c-3364905de732 req-22a95ff0-2e04-44d0-84f3-3a1fccb0bcc6 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:55.921072 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-4b56b39d-4976-4c49-a37c-3364905de732 req-22a95ff0-2e04-44d0-84f3-3a1fccb0bcc6 service nova] Creating event network-vif-deleted:4a5ec398-b2ae-4b98-9376-8ce6519452c5 for instance 908a1e75-facc-4a4c-b602-10be600c40a3 on hv-cinder-82002 Jul 12 14:44:55.927482 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-4b56b39d-4976-4c49-a37c-3364905de732 req-22a95ff0-2e04-44d0-84f3-3a1fccb0bcc6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033481 Jul 12 14:44:55.928406 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 345/691] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:44:56.043061 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-fed7c25d-e443-436b-a23d-32b25d155c5c tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:56.044901 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-fed7c25d-e443-436b-a23d-32b25d155c5c tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] [instance: 908a1e75-facc-4a4c-b602-10be600c40a3] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:56.056214 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fed7c25d-e443-436b-a23d-32b25d155c5c tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:56.056839 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fed7c25d-e443-436b-a23d-32b25d155c5c tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:56.057846 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fed7c25d-e443-436b-a23d-32b25d155c5c tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:56.061756 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fed7c25d-e443-436b-a23d-32b25d155c5c tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:56.134462 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-fed7c25d-e443-436b-a23d-32b25d155c5c tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd982cea06a4e9ebecf3eee2590e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6f8aec4ba48789e2b40eb2196e73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:56.142271 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-fed7c25d-e443-436b-a23d-32b25d155c5c tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] 10.222.0.30 "GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3" status: 200 len: 1428 microversion: 2.1 time: 0.104154 Jul 12 14:44:56.142844 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 347/692] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:56 2022] GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3 => generated 1428 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:56.409697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-aaeaae40-657a-4e7f-94f4-316d3cb22866 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:56.411418 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-aaeaae40-657a-4e7f-94f4-316d3cb22866 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:56.414471 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:56.419917 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-aaeaae40-657a-4e7f-94f4-316d3cb22866 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:56.420364 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-aaeaae40-657a-4e7f-94f4-316d3cb22866 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:56.421188 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-aaeaae40-657a-4e7f-94f4-316d3cb22866 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:56.421628 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-aaeaae40-657a-4e7f-94f4-316d3cb22866 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:56.466486 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-aaeaae40-657a-4e7f-94f4-316d3cb22866 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064353 Jul 12 14:44:56.467413 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 346/693] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Jul 12 14:44:56 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:44:57.160889 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e2bbc1c8-4189-4ee5-8170-40a89a3e2c9b tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:57.162124 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-e2bbc1c8-4189-4ee5-8170-40a89a3e2c9b tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] [instance: 908a1e75-facc-4a4c-b602-10be600c40a3] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:57.169207 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e2bbc1c8-4189-4ee5-8170-40a89a3e2c9b tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:57.169992 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e2bbc1c8-4189-4ee5-8170-40a89a3e2c9b tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:57.170988 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e2bbc1c8-4189-4ee5-8170-40a89a3e2c9b tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:57.171647 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e2bbc1c8-4189-4ee5-8170-40a89a3e2c9b tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:57.230090 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e2bbc1c8-4189-4ee5-8170-40a89a3e2c9b tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:57.230553 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e2bbc1c8-4189-4ee5-8170-40a89a3e2c9b tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:57.231203 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.objects.instance [None req-e2bbc1c8-4189-4ee5-8170-40a89a3e2c9b tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lazy-loading 'fault' on Instance uuid 908a1e75-facc-4a4c-b602-10be600c40a3 {{(pid=129981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:44:57.289871 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e2bbc1c8-4189-4ee5-8170-40a89a3e2c9b tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd982cea06a4e9ebecf3eee2590e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6f8aec4ba48789e2b40eb2196e73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:57.293551 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:57.299514 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-e2bbc1c8-4189-4ee5-8170-40a89a3e2c9b tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] 10.222.0.30 "GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3" status: 200 len: 1304 microversion: 2.1 time: 0.143716 Jul 12 14:44:57.300662 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 348/694] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:57 2022] GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3 => generated 1304 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:57.483276 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-a3d8a760-62c1-4ecf-9b87-528e0f9595d4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:57.484809 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-a3d8a760-62c1-4ecf-9b87-528e0f9595d4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:57.494001 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a3d8a760-62c1-4ecf-9b87-528e0f9595d4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:57.494895 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a3d8a760-62c1-4ecf-9b87-528e0f9595d4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:57.495904 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a3d8a760-62c1-4ecf-9b87-528e0f9595d4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:57.496340 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a3d8a760-62c1-4ecf-9b87-528e0f9595d4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:57.539309 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-a3d8a760-62c1-4ecf-9b87-528e0f9595d4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064062 Jul 12 14:44:57.540187 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 347/695] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Jul 12 14:44:57 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 14:44:57.553793 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-5d14b75b-6a62-4889-a0c4-56b06b6c0a6b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:57.558792 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-5d14b75b-6a62-4889-a0c4-56b06b6c0a6b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:57.567262 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5d14b75b-6a62-4889-a0c4-56b06b6c0a6b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:57.567953 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5d14b75b-6a62-4889-a0c4-56b06b6c0a6b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:57.569441 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5d14b75b-6a62-4889-a0c4-56b06b6c0a6b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:57.570553 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5d14b75b-6a62-4889-a0c4-56b06b6c0a6b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:57.632508 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-5d14b75b-6a62-4889-a0c4-56b06b6c0a6b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.087872 Jul 12 14:44:57.633934 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-3031a34a-c5b0-4943-b810-bb38a39f36e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:57.634627 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-3031a34a-c5b0-4943-b810-bb38a39f36e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:57.638000 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 349/696] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Jul 12 14:44:57 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 14:44:57.645895 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3031a34a-c5b0-4943-b810-bb38a39f36e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:57.646845 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3031a34a-c5b0-4943-b810-bb38a39f36e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:57.648149 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3031a34a-c5b0-4943-b810-bb38a39f36e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:57.648801 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3031a34a-c5b0-4943-b810-bb38a39f36e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:57.686850 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-3031a34a-c5b0-4943-b810-bb38a39f36e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Going to try to terminate instance {{(pid=129980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:44:57.701432 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-b88ed00f-ef27-41ab-bdc8-6101ee48bae2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:57.701936 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-b88ed00f-ef27-41ab-bdc8-6101ee48bae2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:57.708494 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b88ed00f-ef27-41ab-bdc8-6101ee48bae2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:57.709070 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b88ed00f-ef27-41ab-bdc8-6101ee48bae2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:57.710145 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b88ed00f-ef27-41ab-bdc8-6101ee48bae2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:57.710596 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b88ed00f-ef27-41ab-bdc8-6101ee48bae2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:57.738740 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-b88ed00f-ef27-41ab-bdc8-6101ee48bae2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Going to try to terminate instance {{(pid=129981) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:44:58.014602 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-3031a34a-c5b0-4943-b810-bb38a39f36e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 204 len: 0 microversion: 2.1 time: 0.386256 Jul 12 14:44:58.015443 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 348/697] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Jul 12 14:44:57 2022] DELETE /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:44:58.028851 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-fe8245c2-2386-4509-aedf-d972fa9b73ea tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:58.028851 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-fe8245c2-2386-4509-aedf-d972fa9b73ea tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:58.032417 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fe8245c2-2386-4509-aedf-d972fa9b73ea tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:58.032882 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fe8245c2-2386-4509-aedf-d972fa9b73ea tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:58.033753 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fe8245c2-2386-4509-aedf-d972fa9b73ea tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:58.034299 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fe8245c2-2386-4509-aedf-d972fa9b73ea tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:58.181125 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-b88ed00f-ef27-41ab-bdc8-6101ee48bae2 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 204 len: 0 microversion: 2.1 time: 0.483304 Jul 12 14:44:58.181782 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 350/698] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Jul 12 14:44:57 2022] DELETE /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 14:44:58.192036 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-76ca4976-ae3b-46e7-b67a-6eb4b824cc22 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:58.193869 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-76ca4976-ae3b-46e7-b67a-6eb4b824cc22 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:58.214713 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-76ca4976-ae3b-46e7-b67a-6eb4b824cc22 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:58.219004 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-76ca4976-ae3b-46e7-b67a-6eb4b824cc22 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:58.219004 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-76ca4976-ae3b-46e7-b67a-6eb4b824cc22 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:58.219004 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-76ca4976-ae3b-46e7-b67a-6eb4b824cc22 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:58.229799 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-fe8245c2-2386-4509-aedf-d972fa9b73ea tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:58.243728 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-fe8245c2-2386-4509-aedf-d972fa9b73ea tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1689 microversion: 2.1 time: 0.223364 Jul 12 14:44:58.257356 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 349/699] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:58 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1689 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:58.322437 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-9063e069-d13a-4e91-b6f7-99381138d987 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:58.327977 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-9063e069-d13a-4e91-b6f7-99381138d987 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] [instance: 908a1e75-facc-4a4c-b602-10be600c40a3] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:58.340851 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9063e069-d13a-4e91-b6f7-99381138d987 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:58.341332 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9063e069-d13a-4e91-b6f7-99381138d987 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:58.342166 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9063e069-d13a-4e91-b6f7-99381138d987 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:58.342605 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9063e069-d13a-4e91-b6f7-99381138d987 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:58.359427 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.wsgi [None req-9063e069-d13a-4e91-b6f7-99381138d987 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] HTTP exception thrown: Instance 908a1e75-facc-4a4c-b602-10be600c40a3 could not be found. Jul 12 14:44:58.362051 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-9063e069-d13a-4e91-b6f7-99381138d987 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Request method failure captured: Jul 12 14:44:58.362051 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: request: GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3 HTTP/1.1 Jul 12 14:44:58.362051 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept: application/json Jul 12 14:44:58.362051 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept-Encoding: identity Jul 12 14:44:58.362051 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Connection: close Jul 12 14:44:58.362051 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Length: 0 Jul 12 14:44:58.362051 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Type: application/json Jul 12 14:44:58.362051 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Host: 10.222.0.30 Jul 12 14:44:58.362051 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Openstack-System-Scope: None Jul 12 14:44:58.362051 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: User-Agent: python-urllib3/1.26.9 Jul 12 14:44:58.362051 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Auth-Token: gAAAAABizYjUcqRIJNUca104ixKLD11jWN4EOJ57z2D7EwTkCtuIfkchXsYA-Hgb8Vqj-VXzQxDkvzxfs2HAU4QiA8a58I50zlBC23xZrnJpGR5Y1n-Voj5-Uzzmj_jglFasWpXRmI8vuPVK5yWeuTZWMbr7pXRj7SFQ2gyfrLi2zH0pgtYGFMQ Jul 12 14:44:58.362051 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Id: None Jul 12 14:44:58.362051 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Name: None Jul 12 14:44:58.362051 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Identity-Status: Confirmed Jul 12 14:44:58.362051 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Is-Admin-Project: True Jul 12 14:44:58.362051 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Id: default Jul 12 14:44:58.362051 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Name: Default Jul 12 14:44:58.362051 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Id: f5e6f8aec4ba48789e2b40eb2196e73c Jul 12 14:44:58.362051 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Name: tempest-VolumesNegativeTest-1263426691 Jul 12 14:44:58.362051 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Role: member,reader Jul 12 14:44:58.362051 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Roles: member,reader Jul 12 14:44:58.363402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f5e6f8aec4ba48789e2b40eb2196e73c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f5e6f8aec4ba48789e2b40eb2196e73c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f5e6f8aec4ba48789e2b40eb2196e73c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f5e6f8aec4ba48789e2b40eb2196e73c", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:44:58.363402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant: tempest-VolumesNegativeTest-1263426691 Jul 12 14:44:58.363402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Id: f5e6f8aec4ba48789e2b40eb2196e73c Jul 12 14:44:58.363402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Name: tempest-VolumesNegativeTest-1263426691 Jul 12 14:44:58.363402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User: tempest-VolumesNegativeTest-1263426691-project Jul 12 14:44:58.363402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Id: default Jul 12 14:44:58.363402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Name: Default Jul 12 14:44:58.363402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Id: cbd982cea06a4e9ebecf3eee2590e8d8 Jul 12 14:44:58.363402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Name: tempest-VolumesNegativeTest-1263426691-project Jul 12 14:44:58.363402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: method: > Jul 12 14:44:58.363402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: exception: Instance 908a1e75-facc-4a4c-b602-10be600c40a3 could not be found. Jul 12 14:44:58.363402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: action_args: {'id': '908a1e75-facc-4a4c-b602-10be600c40a3'} Jul 12 14:44:58.364170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:44:58.364170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:58.364170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:44:58.364170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:44:58.364170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:44:58.364170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:44:58.364170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:44:58.364170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:44:58.364170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:44:58.364170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:44:58.364170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 908a1e75-facc-4a4c-b602-10be600c40a3 could not be found. Jul 12 14:44:58.364170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:44:58.364170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:44:58.364170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:44:58.364170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:58.364170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:44:58.364170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:44:58.364170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:44:58.364170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:44:58.364170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:44:58.365438 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:44:58.365438 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:44:58.365438 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:44:58.365438 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:44:58.365438 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:44:58.365438 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:44:58.365438 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:44:58.365438 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 908a1e75-facc-4a4c-b602-10be600c40a3 could not be found. Jul 12 14:44:58.365438 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:44:58.365438 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:44:58.365438 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:44:58.365438 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:58.365438 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:44:58.365438 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:44:58.365438 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:44:58.365438 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:44:58.365438 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 908a1e75-facc-4a4c-b602-10be600c40a3 could not be found. Jul 12 14:44:58.365438 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:44:58.369933 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-9063e069-d13a-4e91-b6f7-99381138d987 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] Returning 404 to user: Instance 908a1e75-facc-4a4c-b602-10be600c40a3 could not be found. {{(pid=129980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:44:58.370400 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-9063e069-d13a-4e91-b6f7-99381138d987 tempest-VolumesNegativeTest-1263426691 tempest-VolumesNegativeTest-1263426691-project] 10.222.0.30 "GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3" status: 404 len: 111 microversion: 2.1 time: 0.057088 Jul 12 14:44:58.371295 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 350/700] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:58 2022] GET /compute/v2.1/servers/908a1e75-facc-4a4c-b602-10be600c40a3 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 14:44:58.445146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-76ca4976-ae3b-46e7-b67a-6eb4b824cc22 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:58.455077 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-76ca4976-ae3b-46e7-b67a-6eb4b824cc22 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1674 microversion: 2.1 time: 0.267840 Jul 12 14:44:58.455745 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 351/701] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:58 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1674 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:44:59.264328 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-099c91c7-8cbe-4f05-9783-e05368c5e26b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:59.273760 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-099c91c7-8cbe-4f05-9783-e05368c5e26b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:59.291724 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-099c91c7-8cbe-4f05-9783-e05368c5e26b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:59.292473 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-099c91c7-8cbe-4f05-9783-e05368c5e26b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:59.293541 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-099c91c7-8cbe-4f05-9783-e05368c5e26b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:59.294234 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-099c91c7-8cbe-4f05-9783-e05368c5e26b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:59.474033 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-eaa13695-acf2-4a20-b405-f39659d5814c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:59.475367 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-eaa13695-acf2-4a20-b405-f39659d5814c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:59.486926 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-eaa13695-acf2-4a20-b405-f39659d5814c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:59.487651 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-eaa13695-acf2-4a20-b405-f39659d5814c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:59.488705 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-eaa13695-acf2-4a20-b405-f39659d5814c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:59.489472 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-eaa13695-acf2-4a20-b405-f39659d5814c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:59.515155 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-099c91c7-8cbe-4f05-9783-e05368c5e26b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:59.536975 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-099c91c7-8cbe-4f05-9783-e05368c5e26b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1689 microversion: 2.1 time: 0.277459 Jul 12 14:44:59.538372 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 351/702] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:59 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1689 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:59.650706 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-eaa13695-acf2-4a20-b405-f39659d5814c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:59.659505 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-eaa13695-acf2-4a20-b405-f39659d5814c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1674 microversion: 2.1 time: 0.190805 Jul 12 14:44:59.660350 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 352/703] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:59 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1674 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:00.554471 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-fd0d42f3-6560-4da0-ac5f-eaff9d89581d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:00.555105 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-fd0d42f3-6560-4da0-ac5f-eaff9d89581d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:00.561644 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fd0d42f3-6560-4da0-ac5f-eaff9d89581d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:00.562096 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fd0d42f3-6560-4da0-ac5f-eaff9d89581d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:00.562861 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fd0d42f3-6560-4da0-ac5f-eaff9d89581d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:00.563327 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fd0d42f3-6560-4da0-ac5f-eaff9d89581d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:00.678745 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-06a61c14-0430-4589-b6e5-4d12ded7d77a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:00.680066 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-06a61c14-0430-4589-b6e5-4d12ded7d77a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:00.688748 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-06a61c14-0430-4589-b6e5-4d12ded7d77a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:00.689218 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-06a61c14-0430-4589-b6e5-4d12ded7d77a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:00.690422 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-06a61c14-0430-4589-b6e5-4d12ded7d77a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:00.691035 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-06a61c14-0430-4589-b6e5-4d12ded7d77a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:00.719541 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-fd0d42f3-6560-4da0-ac5f-eaff9d89581d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:00.727829 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-fd0d42f3-6560-4da0-ac5f-eaff9d89581d tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1689 microversion: 2.1 time: 0.177372 Jul 12 14:45:00.728405 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 352/704] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:00 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:45:00.834590 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-06a61c14-0430-4589-b6e5-4d12ded7d77a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:00.849271 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-06a61c14-0430-4589-b6e5-4d12ded7d77a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1674 microversion: 2.1 time: 0.175983 Jul 12 14:45:00.859156 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 353/705] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:00 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1674 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:45:01.745336 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-125865cb-de43-4cb2-a254-df94c2413b6c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:01.746253 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-125865cb-de43-4cb2-a254-df94c2413b6c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:01.754653 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-125865cb-de43-4cb2-a254-df94c2413b6c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:01.755379 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-125865cb-de43-4cb2-a254-df94c2413b6c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:01.756255 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-125865cb-de43-4cb2-a254-df94c2413b6c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:01.756808 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-125865cb-de43-4cb2-a254-df94c2413b6c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:01.866736 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-cdea1d51-4d7c-4891-a287-7b7baa684669 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:01.867428 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-cdea1d51-4d7c-4891-a287-7b7baa684669 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:01.879273 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:UPDATE=3 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:01.881180 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-cdea1d51-4d7c-4891-a287-7b7baa684669 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:01.881791 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-cdea1d51-4d7c-4891-a287-7b7baa684669 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:01.882761 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-cdea1d51-4d7c-4891-a287-7b7baa684669 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:01.883368 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-cdea1d51-4d7c-4891-a287-7b7baa684669 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:02.026786 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-125865cb-de43-4cb2-a254-df94c2413b6c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:02.039293 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-125865cb-de43-4cb2-a254-df94c2413b6c tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1689 microversion: 2.1 time: 0.297861 Jul 12 14:45:02.040089 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 353/706] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:01 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1689 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:02.131459 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-cdea1d51-4d7c-4891-a287-7b7baa684669 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:02.139111 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-cdea1d51-4d7c-4891-a287-7b7baa684669 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1674 microversion: 2.1 time: 0.276277 Jul 12 14:45:02.139883 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 354/707] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:01 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1674 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:03.056091 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-3ee6f7f3-f2e7-4aaf-8709-581aaf4aee4a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:03.056717 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-3ee6f7f3-f2e7-4aaf-8709-581aaf4aee4a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:03.064023 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3ee6f7f3-f2e7-4aaf-8709-581aaf4aee4a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:03.064849 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3ee6f7f3-f2e7-4aaf-8709-581aaf4aee4a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:03.066374 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3ee6f7f3-f2e7-4aaf-8709-581aaf4aee4a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:03.066982 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3ee6f7f3-f2e7-4aaf-8709-581aaf4aee4a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:03.167046 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-0ec5a416-7e67-4deb-b795-2ae6140d83b1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:03.169313 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-0ec5a416-7e67-4deb-b795-2ae6140d83b1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:03.177754 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0ec5a416-7e67-4deb-b795-2ae6140d83b1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:03.178463 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0ec5a416-7e67-4deb-b795-2ae6140d83b1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:03.179460 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0ec5a416-7e67-4deb-b795-2ae6140d83b1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:03.180069 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0ec5a416-7e67-4deb-b795-2ae6140d83b1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:03.567877 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-0ec5a416-7e67-4deb-b795-2ae6140d83b1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:03.575919 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-0ec5a416-7e67-4deb-b795-2ae6140d83b1 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1674 microversion: 2.1 time: 0.423035 Jul 12 14:45:03.576838 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 355/708] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:03 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1674 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:45:03.595835 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-3ee6f7f3-f2e7-4aaf-8709-581aaf4aee4a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:03.613426 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-3ee6f7f3-f2e7-4aaf-8709-581aaf4aee4a tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1689 microversion: 2.1 time: 0.560224 Jul 12 14:45:03.614371 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 354/709] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:03 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1689 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:04.604701 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-5bf5a386-f34b-4ce3-b1f8-3fb09cb4b9ca tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:04.604701 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-5bf5a386-f34b-4ce3-b1f8-3fb09cb4b9ca tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:04.622565 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5bf5a386-f34b-4ce3-b1f8-3fb09cb4b9ca tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:04.623184 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5bf5a386-f34b-4ce3-b1f8-3fb09cb4b9ca tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:04.624166 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5bf5a386-f34b-4ce3-b1f8-3fb09cb4b9ca tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:04.624971 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5bf5a386-f34b-4ce3-b1f8-3fb09cb4b9ca tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:04.632527 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-33273bb9-fc20-4495-9e11-54fd93e0b0e1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:04.633322 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-33273bb9-fc20-4495-9e11-54fd93e0b0e1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:04.649462 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-33273bb9-fc20-4495-9e11-54fd93e0b0e1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:04.652775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-33273bb9-fc20-4495-9e11-54fd93e0b0e1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:04.653774 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-33273bb9-fc20-4495-9e11-54fd93e0b0e1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:04.659567 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-33273bb9-fc20-4495-9e11-54fd93e0b0e1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:05.161416 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-33273bb9-fc20-4495-9e11-54fd93e0b0e1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:05.184934 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-33273bb9-fc20-4495-9e11-54fd93e0b0e1 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1689 microversion: 2.1 time: 0.548095 Jul 12 14:45:05.185787 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 355/710] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:04 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1689 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:05.271823 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-5bf5a386-f34b-4ce3-b1f8-3fb09cb4b9ca tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:05.307893 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-5bf5a386-f34b-4ce3-b1f8-3fb09cb4b9ca tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1674 microversion: 2.1 time: 0.708414 Jul 12 14:45:05.320356 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 356/711] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:04 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1674 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:05.387310 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-554dca90-e409-47fb-a77c-b13bcf52f8f2 req-1d5bd74b-76f5-461c-a4f9-90efb805865b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a9deddf-4864-4ad7-9f64-51b96f7c45eb", "name": "network-vif-deleted", "tag": "12bf018a-5099-450d-857c-a8150eca7139"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:45:05.402980 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-554dca90-e409-47fb-a77c-b13bcf52f8f2 req-1d5bd74b-76f5-461c-a4f9-90efb805865b service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:05.406465 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-554dca90-e409-47fb-a77c-b13bcf52f8f2 req-1d5bd74b-76f5-461c-a4f9-90efb805865b service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:05.423105 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-554dca90-e409-47fb-a77c-b13bcf52f8f2 req-1d5bd74b-76f5-461c-a4f9-90efb805865b service nova] Creating event network-vif-deleted:12bf018a-5099-450d-857c-a8150eca7139 for instance 8a9deddf-4864-4ad7-9f64-51b96f7c45eb on hv-cinder-82002 Jul 12 14:45:05.460322 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-554dca90-e409-47fb-a77c-b13bcf52f8f2 req-1d5bd74b-76f5-461c-a4f9-90efb805865b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077116 Jul 12 14:45:05.465793 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 356/712] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:45:06.212960 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c0796da2-625b-4ce4-b48e-fb4fbb96aca3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:06.218433 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-c0796da2-625b-4ce4-b48e-fb4fbb96aca3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:06.248136 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c0796da2-625b-4ce4-b48e-fb4fbb96aca3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:06.252450 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c0796da2-625b-4ce4-b48e-fb4fbb96aca3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:06.253549 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c0796da2-625b-4ce4-b48e-fb4fbb96aca3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:06.256248 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c0796da2-625b-4ce4-b48e-fb4fbb96aca3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:06.352242 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c0796da2-625b-4ce4-b48e-fb4fbb96aca3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:06.353660 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c0796da2-625b-4ce4-b48e-fb4fbb96aca3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:06.355230 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.objects.instance [None req-c0796da2-625b-4ce4-b48e-fb4fbb96aca3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lazy-loading 'fault' on Instance uuid 8a9deddf-4864-4ad7-9f64-51b96f7c45eb {{(pid=129981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:45:06.427263 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c0796da2-625b-4ce4-b48e-fb4fbb96aca3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:06.438653 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-c0796da2-625b-4ce4-b48e-fb4fbb96aca3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 200 len: 1335 microversion: 2.1 time: 0.238689 Jul 12 14:45:06.448387 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 357/713] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:06 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 1335 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:06.465991 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-5a6ee992-d4bf-4985-be91-732b180bcbaf tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:06.467568 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-5a6ee992-d4bf-4985-be91-732b180bcbaf tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:06.479718 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5a6ee992-d4bf-4985-be91-732b180bcbaf tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:06.484135 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5a6ee992-d4bf-4985-be91-732b180bcbaf tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:06.487061 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5a6ee992-d4bf-4985-be91-732b180bcbaf tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:06.487747 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5a6ee992-d4bf-4985-be91-732b180bcbaf tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:06.534883 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-4cb13efb-22c5-407c-86b9-2b2cfbb05124 req-ca040f90-736c-4e9a-b730-3bf5c2561a29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8f59b92-aa7f-496d-a19c-9035a4948560", "name": "network-vif-deleted", "tag": "68fcc4b4-c1bb-4548-816a-03ac719e76aa"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:45:06.545792 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-4cb13efb-22c5-407c-86b9-2b2cfbb05124 req-ca040f90-736c-4e9a-b730-3bf5c2561a29 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:06.545792 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-4cb13efb-22c5-407c-86b9-2b2cfbb05124 req-ca040f90-736c-4e9a-b730-3bf5c2561a29 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:06.561058 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-4cb13efb-22c5-407c-86b9-2b2cfbb05124 req-ca040f90-736c-4e9a-b730-3bf5c2561a29 service nova] Creating event network-vif-deleted:68fcc4b4-c1bb-4548-816a-03ac719e76aa for instance b8f59b92-aa7f-496d-a19c-9035a4948560 on hv-cinder-82002 Jul 12 14:45:06.570518 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-4cb13efb-22c5-407c-86b9-2b2cfbb05124 req-ca040f90-736c-4e9a-b730-3bf5c2561a29 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.289743 Jul 12 14:45:06.571380 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 357/714] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:45:06.624018 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-5a6ee992-d4bf-4985-be91-732b180bcbaf tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:06.638769 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-5a6ee992-d4bf-4985-be91-732b180bcbaf tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 200 len: 1607 microversion: 2.1 time: 0.195842 Jul 12 14:45:06.641591 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 358/715] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:06 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 1607 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:07.457372 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0d610a95-9a73-49dd-98f9-09271534a6e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:07.458390 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-0d610a95-9a73-49dd-98f9-09271534a6e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 8a9deddf-4864-4ad7-9f64-51b96f7c45eb] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:07.465452 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0d610a95-9a73-49dd-98f9-09271534a6e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:07.466206 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0d610a95-9a73-49dd-98f9-09271534a6e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:07.467307 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0d610a95-9a73-49dd-98f9-09271534a6e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:07.467983 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0d610a95-9a73-49dd-98f9-09271534a6e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:07.483972 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.wsgi [None req-0d610a95-9a73-49dd-98f9-09271534a6e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] HTTP exception thrown: Instance 8a9deddf-4864-4ad7-9f64-51b96f7c45eb could not be found. Jul 12 14:45:07.486287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0d610a95-9a73-49dd-98f9-09271534a6e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Request method failure captured: Jul 12 14:45:07.486287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: request: GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb HTTP/1.1 Jul 12 14:45:07.486287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept: application/json Jul 12 14:45:07.486287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept-Encoding: identity Jul 12 14:45:07.486287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Connection: close Jul 12 14:45:07.486287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Length: 0 Jul 12 14:45:07.486287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Type: application/json Jul 12 14:45:07.486287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Host: 10.222.0.30 Jul 12 14:45:07.486287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Openstack-System-Scope: None Jul 12 14:45:07.486287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: User-Agent: python-urllib3/1.26.9 Jul 12 14:45:07.486287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Auth-Token: gAAAAABizYehYws4HrgGrv1QXrmsu2xWw8GXYW-BydE4l3b7e715YjEfH2g10AAcubc3F8Fua7xKtXboov3Y2Z32aGrkzrkDds152RTIhjLssnjoz683AGXZ-ffmMw8OOKRJ4-u7WEcb8UqTTsJ21R318wN3uwczHyiupKx-Uh53TY_6T4OsmzU Jul 12 14:45:07.486287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Id: None Jul 12 14:45:07.486287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Name: None Jul 12 14:45:07.486287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Identity-Status: Confirmed Jul 12 14:45:07.486287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Is-Admin-Project: True Jul 12 14:45:07.486287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Id: default Jul 12 14:45:07.486287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Name: Default Jul 12 14:45:07.486287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Id: fe2b01873d92453599763e5523a862f8 Jul 12 14:45:07.486287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-241601666 Jul 12 14:45:07.486287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Role: member,reader Jul 12 14:45:07.486287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Roles: member,reader Jul 12 14:45:07.487695 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fe2b01873d92453599763e5523a862f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fe2b01873d92453599763e5523a862f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fe2b01873d92453599763e5523a862f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fe2b01873d92453599763e5523a862f8", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:45:07.487695 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant: tempest-ServerRescueNegativeTestJSON-241601666 Jul 12 14:45:07.487695 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Id: fe2b01873d92453599763e5523a862f8 Jul 12 14:45:07.487695 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-241601666 Jul 12 14:45:07.487695 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User: tempest-ServerRescueNegativeTestJSON-241601666-project Jul 12 14:45:07.487695 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Id: default Jul 12 14:45:07.487695 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Name: Default Jul 12 14:45:07.487695 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Id: 97f1b1e52a984639a504441e3701b981 Jul 12 14:45:07.487695 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Name: tempest-ServerRescueNegativeTestJSON-241601666-project Jul 12 14:45:07.487695 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: method: > Jul 12 14:45:07.487695 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: exception: Instance 8a9deddf-4864-4ad7-9f64-51b96f7c45eb could not be found. Jul 12 14:45:07.487695 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: action_args: {'id': '8a9deddf-4864-4ad7-9f64-51b96f7c45eb'} Jul 12 14:45:07.488481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:45:07.488481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:45:07.488481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:45:07.488481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:45:07.488481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:45:07.488481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:45:07.488481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:45:07.488481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:45:07.488481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:45:07.488481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:45:07.488481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a9deddf-4864-4ad7-9f64-51b96f7c45eb could not be found. Jul 12 14:45:07.488481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:45:07.488481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:45:07.488481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:45:07.488481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:45:07.488481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:45:07.488481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:45:07.488481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:45:07.488481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:45:07.488481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:45:07.489932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:45:07.489932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:45:07.489932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:45:07.489932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:45:07.489932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:45:07.489932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:45:07.489932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:45:07.489932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a9deddf-4864-4ad7-9f64-51b96f7c45eb could not be found. Jul 12 14:45:07.489932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:45:07.489932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:45:07.489932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:45:07.489932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:45:07.489932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:45:07.489932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:45:07.489932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:45:07.489932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:45:07.489932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a9deddf-4864-4ad7-9f64-51b96f7c45eb could not be found. Jul 12 14:45:07.489932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:45:07.492927 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0d610a95-9a73-49dd-98f9-09271534a6e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Returning 404 to user: Instance 8a9deddf-4864-4ad7-9f64-51b96f7c45eb could not be found. {{(pid=129980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:45:07.492927 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-0d610a95-9a73-49dd-98f9-09271534a6e3 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb" status: 404 len: 111 microversion: 2.1 time: 0.035504 Jul 12 14:45:07.492927 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 358/716] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:07 2022] GET /compute/v2.1/servers/8a9deddf-4864-4ad7-9f64-51b96f7c45eb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:45:07.496507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-8f4c9bcf-c068-4ad0-9737-ebe0977644ff tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '.version_select at 0x7f962c80c700>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:07.656243 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-8f4c9bcf-c068-4ad0-9737-ebe0977644ff tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1663055025" status: 202 len: 0 microversion: 2.1 time: 0.163361 Jul 12 14:45:07.657423 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 359/717] 10.222.0.30 () {58 vars in 1220 bytes} [Tue Jul 12 14:45:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1663055025 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:45:07.662174 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-9f3e59dd-35b4-438a-803b-d52426826c5c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:07.666176 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-9f3e59dd-35b4-438a-803b-d52426826c5c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:07.729313 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9f3e59dd-35b4-438a-803b-d52426826c5c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:07.735557 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9f3e59dd-35b4-438a-803b-d52426826c5c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:07.735557 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9f3e59dd-35b4-438a-803b-d52426826c5c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:07.744167 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9f3e59dd-35b4-438a-803b-d52426826c5c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:07.776305 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.wsgi [None req-9f3e59dd-35b4-438a-803b-d52426826c5c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] HTTP exception thrown: Instance b8f59b92-aa7f-496d-a19c-9035a4948560 could not be found. Jul 12 14:45:07.785709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-9f3e59dd-35b4-438a-803b-d52426826c5c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Request method failure captured: Jul 12 14:45:07.785709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: request: GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 HTTP/1.1 Jul 12 14:45:07.785709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept: application/json Jul 12 14:45:07.785709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept-Encoding: identity Jul 12 14:45:07.785709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Connection: close Jul 12 14:45:07.785709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Length: 0 Jul 12 14:45:07.785709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Type: application/json Jul 12 14:45:07.785709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Host: 10.222.0.30 Jul 12 14:45:07.785709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Openstack-System-Scope: None Jul 12 14:45:07.785709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: User-Agent: python-urllib3/1.26.9 Jul 12 14:45:07.785709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Auth-Token: gAAAAABizYefRPL1Y5GiliCzIK08041f1Xxv1Ly2Io92QPGJA-es3aoqpvK1tGkAqQB5fyoYZ3ClU870S111187SuwpRMPJRyhk3AsIKs4BN17uqZUvFCQEi7vdAzPhV4xJpo7kqnPIrySsHTNx3xSjU6VY6elQK0bX17gwzq2pB_ccF3Vb95iQ Jul 12 14:45:07.785709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Id: None Jul 12 14:45:07.785709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Name: None Jul 12 14:45:07.785709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Identity-Status: Confirmed Jul 12 14:45:07.785709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Is-Admin-Project: True Jul 12 14:45:07.785709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Id: default Jul 12 14:45:07.785709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Name: Default Jul 12 14:45:07.785709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Id: 52569bf4eba24c2a9fa0ef8c26b8b22d Jul 12 14:45:07.785709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Name: tempest-AttachVolumeTestJSON-1798153056 Jul 12 14:45:07.785709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Role: member,reader Jul 12 14:45:07.785709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Roles: member,reader Jul 12 14:45:07.787548 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/52569bf4eba24c2a9fa0ef8c26b8b22d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/52569bf4eba24c2a9fa0ef8c26b8b22d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/52569bf4eba24c2a9fa0ef8c26b8b22d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_52569bf4eba24c2a9fa0ef8c26b8b22d", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:45:07.787548 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant: tempest-AttachVolumeTestJSON-1798153056 Jul 12 14:45:07.787548 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Id: 52569bf4eba24c2a9fa0ef8c26b8b22d Jul 12 14:45:07.787548 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1798153056 Jul 12 14:45:07.787548 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User: tempest-AttachVolumeTestJSON-1798153056-project Jul 12 14:45:07.787548 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Id: default Jul 12 14:45:07.787548 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Name: Default Jul 12 14:45:07.787548 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Id: 8f118c0ba8494e6e9f5a4488ebf8d220 Jul 12 14:45:07.787548 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Name: tempest-AttachVolumeTestJSON-1798153056-project Jul 12 14:45:07.787548 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: method: > Jul 12 14:45:07.787548 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: exception: Instance b8f59b92-aa7f-496d-a19c-9035a4948560 could not be found. Jul 12 14:45:07.787548 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: action_args: {'id': 'b8f59b92-aa7f-496d-a19c-9035a4948560'} Jul 12 14:45:07.788359 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:45:07.788359 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:45:07.788359 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:45:07.788359 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:45:07.788359 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:45:07.788359 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:45:07.788359 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:45:07.788359 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:45:07.788359 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:45:07.788359 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:45:07.788359 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8f59b92-aa7f-496d-a19c-9035a4948560 could not be found. Jul 12 14:45:07.788359 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:45:07.788359 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:45:07.788359 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:45:07.788359 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:45:07.788359 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:45:07.788359 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:45:07.788359 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:45:07.788359 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:45:07.788359 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:45:07.789568 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:45:07.789568 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:45:07.789568 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:45:07.789568 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:45:07.789568 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:45:07.789568 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:45:07.789568 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:45:07.789568 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8f59b92-aa7f-496d-a19c-9035a4948560 could not be found. Jul 12 14:45:07.789568 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:45:07.789568 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:45:07.789568 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:45:07.789568 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:45:07.789568 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:45:07.789568 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:45:07.789568 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:45:07.789568 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:45:07.789568 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8f59b92-aa7f-496d-a19c-9035a4948560 could not be found. Jul 12 14:45:07.789568 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:45:07.792254 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-9f3e59dd-35b4-438a-803b-d52426826c5c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Returning 404 to user: Instance b8f59b92-aa7f-496d-a19c-9035a4948560 could not be found. {{(pid=129980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:45:07.793542 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-9f3e59dd-35b4-438a-803b-d52426826c5c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 404 len: 111 microversion: 2.1 time: 0.137846 Jul 12 14:45:07.794630 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 359/718] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:07 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:45:07.803909 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-6a41f751-d473-49d0-989c-72ba92f01f47 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '.version_select at 0x7f962c7fa1f0>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:07.934428 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-6a41f751-d473-49d0-989c-72ba92f01f47 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-645138716" status: 202 len: 0 microversion: 2.1 time: 0.134162 Jul 12 14:45:07.935605 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 360/719] 10.222.0.30 () {58 vars in 1217 bytes} [Tue Jul 12 14:45:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-645138716 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:45:09.288089 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-7a0471c6-0cb1-4554-b864-deeb3f9acfe4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Action: 'create', calling method: .version_select at 0x7f962ca441f0>, body: {"keypair": {"name": "tempest-keypair-1012504499", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZ68cAapduzIQHwY3UzDQB7OvRMQ0AdxhrRl/fTxFFDuK7PTkIeL15LmKQY6aT1fIWaGZoJzuM8TX9xKhZDqjStNSfzB+9juc+wkI6aqB3gBwMQRzA9UxMr/3ruzKgspw=="}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:45:09.316661 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-7a0471c6-0cb1-4554-b864-deeb3f9acfe4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Getting quotas for project 52569bf4eba24c2a9fa0ef8c26b8b22d. Resources: {'key_pairs'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:45:09.327822 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-7a0471c6-0cb1-4554-b864-deeb3f9acfe4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Getting quotas for user 8f118c0ba8494e6e9f5a4488ebf8d220 and project 52569bf4eba24c2a9fa0ef8c26b8b22d. Resources: {'key_pairs'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:45:09.436158 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-7a0471c6-0cb1-4554-b864-deeb3f9acfe4 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.157969 Jul 12 14:45:09.436158 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 360/720] 10.222.0.30 () {60 vars in 1158 bytes} [Tue Jul 12 14:45:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:45:09.844526 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-5d6688f0-9e3f-48ec-b389-354533f55e5c tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Action: 'create', calling method: .version_select at 0x7f962c8161f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-470070880", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkwhaPXqXJWzoMM2On+dhZoApaOl4BEF9/GWHGSTujpzdbHIma0EoEizQ0BYWOTdioJrFTMIRp08OY2NMuuIf+nQf5wV3+F6OoxSC+jDzP9/FDnbQfrHByOoDeXfcT6iw=="}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:45:09.857583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.quota [None req-5d6688f0-9e3f-48ec-b389-354533f55e5c tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Getting quotas for project 8fa20247a7af46d0b9660d4cd026f552. Resources: {'key_pairs'} {{(pid=129981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:45:09.861337 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.quota [None req-5d6688f0-9e3f-48ec-b389-354533f55e5c tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Getting quotas for user df735fc7405643f285f529ddfa611064 and project 8fa20247a7af46d0b9660d4cd026f552. Resources: {'key_pairs'} {{(pid=129981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:45:09.953121 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-5d6688f0-9e3f-48ec-b389-354533f55e5c tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.293370 Jul 12 14:45:09.954341 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 361/721] 10.222.0.30 () {60 vars in 1158 bytes} [Tue Jul 12 14:45:09 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:45:11.629575 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-b7ad1b98-5973-4b13-9ed0-b41e45f1b591 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:11.630073 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-b7ad1b98-5973-4b13-9ed0-b41e45f1b591 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:11.642805 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b7ad1b98-5973-4b13-9ed0-b41e45f1b591 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:11.643254 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b7ad1b98-5973-4b13-9ed0-b41e45f1b591 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:11.644024 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b7ad1b98-5973-4b13-9ed0-b41e45f1b591 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:11.644768 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b7ad1b98-5973-4b13-9ed0-b41e45f1b591 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:11.671336 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-b7ad1b98-5973-4b13-9ed0-b41e45f1b591 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Going to try to terminate instance {{(pid=129980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:45:11.946156 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-b7ad1b98-5973-4b13-9ed0-b41e45f1b591 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 204 len: 0 microversion: 2.1 time: 0.321693 Jul 12 14:45:11.948529 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 361/722] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Jul 12 14:45:11 2022] DELETE /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:45:11.967399 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-0f9b9518-e7bf-4f18-ab5a-7eb2d88cf32e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:11.968018 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-0f9b9518-e7bf-4f18-ab5a-7eb2d88cf32e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:11.975866 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0f9b9518-e7bf-4f18-ab5a-7eb2d88cf32e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:11.976754 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0f9b9518-e7bf-4f18-ab5a-7eb2d88cf32e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:11.977569 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0f9b9518-e7bf-4f18-ab5a-7eb2d88cf32e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:11.978037 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0f9b9518-e7bf-4f18-ab5a-7eb2d88cf32e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:12.054762 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-8672a763-14be-49f6-bfda-d2ff77aea7d9 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-492061468", "imageRef": "a66ccacb-7b1e-4f51-9eaf-069a356e0fdb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0743c566-7c21-4b95-974f-e2dc9a3ae72e"}], "security_groups": [{"name": "tempest-securitygroup--872077224"}], "key_name": "tempest-keypair-1012504499", "user_data": "}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:45:12.187868 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-0f9b9518-e7bf-4f18-ab5a-7eb2d88cf32e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:12.204399 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-0f9b9518-e7bf-4f18-ab5a-7eb2d88cf32e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1507 microversion: 2.1 time: 0.236745 Jul 12 14:45:12.205450 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 362/723] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:11 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1507 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:12.227023 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.network.neutron [None req-8672a763-14be-49f6-bfda-d2ff77aea7d9 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] validate_networks() for [('0743c566-7c21-4b95-974f-e2dc9a3ae72e', None, None, None, None, None)] {{(pid=129980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:45:12.801190 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-8672a763-14be-49f6-bfda-d2ff77aea7d9 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Flavor limits 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:45:12.801801 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-8672a763-14be-49f6-bfda-d2ff77aea7d9 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Image limits 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:45:12.802168 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-8672a763-14be-49f6-bfda-d2ff77aea7d9 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Flavor pref 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:45:12.802584 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-8672a763-14be-49f6-bfda-d2ff77aea7d9 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Image pref 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:45:12.803883 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-8672a763-14be-49f6-bfda-d2ff77aea7d9 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:45:12.815121 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8672a763-14be-49f6-bfda-d2ff77aea7d9 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:12.815986 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8672a763-14be-49f6-bfda-d2ff77aea7d9 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:12.817000 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8672a763-14be-49f6-bfda-d2ff77aea7d9 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:12.817664 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8672a763-14be-49f6-bfda-d2ff77aea7d9 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:12.838304 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-8672a763-14be-49f6-bfda-d2ff77aea7d9 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Getting quotas for project 52569bf4eba24c2a9fa0ef8c26b8b22d. Resources: {'instances', 'cores', 'ram'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:45:12.845743 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-8672a763-14be-49f6-bfda-d2ff77aea7d9 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Getting quotas for user 8f118c0ba8494e6e9f5a4488ebf8d220 and project 52569bf4eba24c2a9fa0ef8c26b8b22d. Resources: {'instances', 'cores', 'ram'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:45:12.861454 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-8672a763-14be-49f6-bfda-d2ff77aea7d9 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Going to run 1 instances... {{(pid=129980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:45:12.863744 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-8672a763-14be-49f6-bfda-d2ff77aea7d9 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a66ccacb-7b1e-4f51-9eaf-069a356e0fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:45:13.006527 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-8672a763-14be-49f6-bfda-d2ff77aea7d9 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.956401 Jul 12 14:45:13.008318 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 362/724] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Jul 12 14:45:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 14:45:13.020323 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-ab29bb9f-e576-4956-80d8-7702587b88cd tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:13.021712 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-ab29bb9f-e576-4956-80d8-7702587b88cd tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:13.093473 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-ab29bb9f-e576-4956-80d8-7702587b88cd tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:13.105345 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-ab29bb9f-e576-4956-80d8-7702587b88cd tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15" status: 200 len: 1237 microversion: 2.1 time: 0.087694 Jul 12 14:45:13.105345 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 363/725] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:13 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 => generated 1237 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:45:13.222696 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-d1144079-9241-4d82-b8c6-c971960d2b55 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:13.223387 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-d1144079-9241-4d82-b8c6-c971960d2b55 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:13.244149 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d1144079-9241-4d82-b8c6-c971960d2b55 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:13.244588 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d1144079-9241-4d82-b8c6-c971960d2b55 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:13.245400 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d1144079-9241-4d82-b8c6-c971960d2b55 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:13.245840 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d1144079-9241-4d82-b8c6-c971960d2b55 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:13.271323 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:13.425356 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-d1144079-9241-4d82-b8c6-c971960d2b55 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:13.435048 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-d1144079-9241-4d82-b8c6-c971960d2b55 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1507 microversion: 2.1 time: 0.216941 Jul 12 14:45:13.435572 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 363/726] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:13 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1507 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:45:14.121115 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-ebef066c-5766-4828-8517-17eff875fe5a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:14.122077 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-ebef066c-5766-4828-8517-17eff875fe5a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:14.131771 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ebef066c-5766-4828-8517-17eff875fe5a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:14.132224 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ebef066c-5766-4828-8517-17eff875fe5a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:14.132999 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ebef066c-5766-4828-8517-17eff875fe5a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:14.133462 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ebef066c-5766-4828-8517-17eff875fe5a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:14.204292 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-ebef066c-5766-4828-8517-17eff875fe5a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:14.211891 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-ebef066c-5766-4828-8517-17eff875fe5a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15" status: 200 len: 1241 microversion: 2.1 time: 0.094662 Jul 12 14:45:14.212621 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 364/727] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:14 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:14.451863 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-71a6d5ce-3559-402a-886e-949a5cde10e9 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:14.452454 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-71a6d5ce-3559-402a-886e-949a5cde10e9 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:14.460020 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-71a6d5ce-3559-402a-886e-949a5cde10e9 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:14.473434 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-71a6d5ce-3559-402a-886e-949a5cde10e9 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:14.473434 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-71a6d5ce-3559-402a-886e-949a5cde10e9 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:14.473434 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-71a6d5ce-3559-402a-886e-949a5cde10e9 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:14.600132 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-71a6d5ce-3559-402a-886e-949a5cde10e9 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:14.612844 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-71a6d5ce-3559-402a-886e-949a5cde10e9 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1465 microversion: 2.1 time: 0.164843 Jul 12 14:45:14.613454 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 364/728] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:14 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1465 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:14.635006 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-8b0ed351-9df3-4b46-b957-cddf6b5a8100 req-bcaedf7e-a367-4302-8ed0-78e12cfe5283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c32aaf0-6aa0-4298-aa4b-a285af8940c7", "name": "network-vif-deleted", "tag": "148d0905-282d-448c-899b-1f113dada0e4"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:45:14.647600 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-8b0ed351-9df3-4b46-b957-cddf6b5a8100 req-bcaedf7e-a367-4302-8ed0-78e12cfe5283 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:14.648278 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-8b0ed351-9df3-4b46-b957-cddf6b5a8100 req-bcaedf7e-a367-4302-8ed0-78e12cfe5283 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:14.664803 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-8b0ed351-9df3-4b46-b957-cddf6b5a8100 req-bcaedf7e-a367-4302-8ed0-78e12cfe5283 service nova] Creating event network-vif-deleted:148d0905-282d-448c-899b-1f113dada0e4 for instance 4c32aaf0-6aa0-4298-aa4b-a285af8940c7 on hv-cinder-82002 Jul 12 14:45:14.670887 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-8b0ed351-9df3-4b46-b957-cddf6b5a8100 req-bcaedf7e-a367-4302-8ed0-78e12cfe5283 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041789 Jul 12 14:45:14.671698 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 365/729] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:45:15.229499 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-bdec0418-9627-4b1b-a399-044af8b54dbe tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:15.230020 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-bdec0418-9627-4b1b-a399-044af8b54dbe tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:15.236260 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bdec0418-9627-4b1b-a399-044af8b54dbe tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:15.236709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bdec0418-9627-4b1b-a399-044af8b54dbe tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:15.237498 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bdec0418-9627-4b1b-a399-044af8b54dbe tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:15.237934 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bdec0418-9627-4b1b-a399-044af8b54dbe tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:15.305590 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-bdec0418-9627-4b1b-a399-044af8b54dbe tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:15.312927 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-bdec0418-9627-4b1b-a399-044af8b54dbe tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15" status: 200 len: 1289 microversion: 2.1 time: 0.087658 Jul 12 14:45:15.313518 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 365/730] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:15 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 => generated 1289 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:15.631722 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e21676f0-a37f-4330-9f65-13795721aa21 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:15.632430 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-e21676f0-a37f-4330-9f65-13795721aa21 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:15.639192 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e21676f0-a37f-4330-9f65-13795721aa21 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:15.639637 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e21676f0-a37f-4330-9f65-13795721aa21 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:15.640646 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e21676f0-a37f-4330-9f65-13795721aa21 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:15.641263 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e21676f0-a37f-4330-9f65-13795721aa21 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:15.675137 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e21676f0-a37f-4330-9f65-13795721aa21 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:15.675591 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e21676f0-a37f-4330-9f65-13795721aa21 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:15.676036 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.objects.instance [None req-e21676f0-a37f-4330-9f65-13795721aa21 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lazy-loading 'fault' on Instance uuid 4c32aaf0-6aa0-4298-aa4b-a285af8940c7 {{(pid=129981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:45:15.749050 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e21676f0-a37f-4330-9f65-13795721aa21 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:15.757315 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-e21676f0-a37f-4330-9f65-13795721aa21 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 200 len: 1312 microversion: 2.1 time: 0.130913 Jul 12 14:45:15.767449 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 366/731] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:15 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 1312 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:16.334119 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-857a5654-e391-4fb2-b302-76fea012ef14 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:16.334747 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-857a5654-e391-4fb2-b302-76fea012ef14 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:16.341275 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-857a5654-e391-4fb2-b302-76fea012ef14 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:16.341733 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-857a5654-e391-4fb2-b302-76fea012ef14 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:16.342512 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-857a5654-e391-4fb2-b302-76fea012ef14 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:16.342959 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-857a5654-e391-4fb2-b302-76fea012ef14 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:16.416489 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-857a5654-e391-4fb2-b302-76fea012ef14 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:16.424969 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-857a5654-e391-4fb2-b302-76fea012ef14 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15" status: 200 len: 1295 microversion: 2.1 time: 0.095038 Jul 12 14:45:16.425649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 366/732] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:16 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 => generated 1295 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:16.775320 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-4ffe4212-0d7e-429e-afc0-035ab1b98e31 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:16.776025 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-4ffe4212-0d7e-429e-afc0-035ab1b98e31 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 4c32aaf0-6aa0-4298-aa4b-a285af8940c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:16.785292 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4ffe4212-0d7e-429e-afc0-035ab1b98e31 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:16.785681 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4ffe4212-0d7e-429e-afc0-035ab1b98e31 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:16.786471 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4ffe4212-0d7e-429e-afc0-035ab1b98e31 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:16.793026 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4ffe4212-0d7e-429e-afc0-035ab1b98e31 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:16.810758 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.wsgi [None req-4ffe4212-0d7e-429e-afc0-035ab1b98e31 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] HTTP exception thrown: Instance 4c32aaf0-6aa0-4298-aa4b-a285af8940c7 could not be found. Jul 12 14:45:16.812412 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-4ffe4212-0d7e-429e-afc0-035ab1b98e31 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Request method failure captured: Jul 12 14:45:16.812412 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 HTTP/1.1 Jul 12 14:45:16.812412 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:45:16.812412 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:45:16.812412 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:45:16.812412 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 0 Jul 12 14:45:16.812412 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:45:16.812412 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:45:16.812412 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:45:16.812412 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:45:16.812412 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYehYws4HrgGrv1QXrmsu2xWw8GXYW-BydE4l3b7e715YjEfH2g10AAcubc3F8Fua7xKtXboov3Y2Z32aGrkzrkDds152RTIhjLssnjoz683AGXZ-ffmMw8OOKRJ4-u7WEcb8UqTTsJ21R318wN3uwczHyiupKx-Uh53TY_6T4OsmzU Jul 12 14:45:16.812412 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:45:16.812412 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:45:16.812412 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:45:16.812412 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:45:16.812412 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:45:16.812412 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:45:16.812412 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: fe2b01873d92453599763e5523a862f8 Jul 12 14:45:16.812412 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-241601666 Jul 12 14:45:16.812412 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:45:16.812412 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:45:16.813748 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fe2b01873d92453599763e5523a862f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fe2b01873d92453599763e5523a862f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fe2b01873d92453599763e5523a862f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fe2b01873d92453599763e5523a862f8", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:45:16.813748 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-ServerRescueNegativeTestJSON-241601666 Jul 12 14:45:16.813748 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: fe2b01873d92453599763e5523a862f8 Jul 12 14:45:16.813748 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-241601666 Jul 12 14:45:16.813748 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-ServerRescueNegativeTestJSON-241601666-project Jul 12 14:45:16.813748 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:45:16.813748 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:45:16.813748 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: 97f1b1e52a984639a504441e3701b981 Jul 12 14:45:16.813748 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-ServerRescueNegativeTestJSON-241601666-project Jul 12 14:45:16.813748 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: > Jul 12 14:45:16.813748 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Instance 4c32aaf0-6aa0-4298-aa4b-a285af8940c7 could not be found. Jul 12 14:45:16.813748 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'id': '4c32aaf0-6aa0-4298-aa4b-a285af8940c7'} Jul 12 14:45:16.814480 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:45:16.814480 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:45:16.814480 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:45:16.814480 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:45:16.814480 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:45:16.814480 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:45:16.814480 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:45:16.814480 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:45:16.814480 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:45:16.814480 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:45:16.814480 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c32aaf0-6aa0-4298-aa4b-a285af8940c7 could not be found. Jul 12 14:45:16.814480 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:45:16.814480 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:45:16.814480 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:45:16.814480 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:45:16.814480 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:45:16.814480 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:45:16.814480 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:45:16.814480 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:45:16.814480 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:45:16.815717 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:45:16.815717 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:45:16.815717 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:45:16.815717 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:45:16.815717 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:45:16.815717 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:45:16.815717 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:45:16.815717 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c32aaf0-6aa0-4298-aa4b-a285af8940c7 could not be found. Jul 12 14:45:16.815717 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:45:16.815717 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:45:16.815717 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:45:16.815717 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:45:16.815717 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:45:16.815717 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:45:16.815717 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:45:16.815717 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:45:16.815717 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c32aaf0-6aa0-4298-aa4b-a285af8940c7 could not be found. Jul 12 14:45:16.815717 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:45:16.816928 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-4ffe4212-0d7e-429e-afc0-035ab1b98e31 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Returning 404 to user: Instance 4c32aaf0-6aa0-4298-aa4b-a285af8940c7 could not be found. {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:45:16.816928 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-4ffe4212-0d7e-429e-afc0-035ab1b98e31 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7" status: 404 len: 111 microversion: 2.1 time: 0.042424 Jul 12 14:45:16.816928 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 367/733] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:16 2022] GET /compute/v2.1/servers/4c32aaf0-6aa0-4298-aa4b-a285af8940c7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:45:16.822989 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-eab0023b-0118-418d-9cb6-cc94051d0824 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:16.823815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-eab0023b-0118-418d-9cb6-cc94051d0824 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:16.830695 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-eab0023b-0118-418d-9cb6-cc94051d0824 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:16.831532 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-eab0023b-0118-418d-9cb6-cc94051d0824 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:16.832474 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-eab0023b-0118-418d-9cb6-cc94051d0824 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:16.833080 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-eab0023b-0118-418d-9cb6-cc94051d0824 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:16.862979 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-eab0023b-0118-418d-9cb6-cc94051d0824 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Going to try to terminate instance {{(pid=129980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:45:17.161609 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-eab0023b-0118-418d-9cb6-cc94051d0824 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 204 len: 0 microversion: 2.1 time: 0.342094 Jul 12 14:45:17.162312 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 367/734] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Jul 12 14:45:16 2022] DELETE /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:45:17.171272 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-eb0f833d-adbc-4e6c-802a-21699960ec16 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:17.171884 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-eb0f833d-adbc-4e6c-802a-21699960ec16 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:17.178853 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-eb0f833d-adbc-4e6c-802a-21699960ec16 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:17.179339 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-eb0f833d-adbc-4e6c-802a-21699960ec16 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:17.180104 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-eb0f833d-adbc-4e6c-802a-21699960ec16 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:17.180536 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-eb0f833d-adbc-4e6c-802a-21699960ec16 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:17.202950 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:17.444033 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ac53a0d7-3dd1-44e0-bfe0-e505fdf6202f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:17.445344 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-ac53a0d7-3dd1-44e0-bfe0-e505fdf6202f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:17.452092 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ac53a0d7-3dd1-44e0-bfe0-e505fdf6202f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:17.452480 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ac53a0d7-3dd1-44e0-bfe0-e505fdf6202f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:17.453301 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ac53a0d7-3dd1-44e0-bfe0-e505fdf6202f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:17.453745 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ac53a0d7-3dd1-44e0-bfe0-e505fdf6202f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:17.508546 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-eb0f833d-adbc-4e6c-802a-21699960ec16 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:17.516460 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-eb0f833d-adbc-4e6c-802a-21699960ec16 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.349305 Jul 12 14:45:17.517060 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 368/735] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:17 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:17.686544 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ac53a0d7-3dd1-44e0-bfe0-e505fdf6202f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:17.694791 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ac53a0d7-3dd1-44e0-bfe0-e505fdf6202f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15" status: 200 len: 1362 microversion: 2.1 time: 0.255957 Jul 12 14:45:17.704274 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 368/736] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:17 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:17.935755 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-a693964b-8e25-4454-8566-270b7412ceab req-2b25be4d-c314-46fe-9995-1b317492ea65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "059eea39-a5fd-4428-8c51-5548bc8b0e15", "tag": "ff00788d-9218-4980-97fc-18cd7b346c4a"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:45:17.946324 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-a693964b-8e25-4454-8566-270b7412ceab req-2b25be4d-c314-46fe-9995-1b317492ea65 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:17.946685 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-a693964b-8e25-4454-8566-270b7412ceab req-2b25be4d-c314-46fe-9995-1b317492ea65 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:17.978618 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-a693964b-8e25-4454-8566-270b7412ceab req-2b25be4d-c314-46fe-9995-1b317492ea65 service nova] Creating event network-changed:ff00788d-9218-4980-97fc-18cd7b346c4a for instance 059eea39-a5fd-4428-8c51-5548bc8b0e15 on hv-cinder-82002 Jul 12 14:45:17.978618 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-a693964b-8e25-4454-8566-270b7412ceab req-2b25be4d-c314-46fe-9995-1b317492ea65 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032390 Jul 12 14:45:17.978618 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 369/737] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:45:18.533874 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-2feaf130-5eff-441a-b786-94382412d68b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:18.534485 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-2feaf130-5eff-441a-b786-94382412d68b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:18.540959 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2feaf130-5eff-441a-b786-94382412d68b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:18.541436 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2feaf130-5eff-441a-b786-94382412d68b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:18.542278 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2feaf130-5eff-441a-b786-94382412d68b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:18.542712 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2feaf130-5eff-441a-b786-94382412d68b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:18.683918 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-2feaf130-5eff-441a-b786-94382412d68b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:18.692463 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-2feaf130-5eff-441a-b786-94382412d68b tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.162470 Jul 12 14:45:18.693033 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 369/738] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:18 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:18.714083 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-8409bc2f-ee39-426d-9815-caf09e6103af tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:18.714713 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-8409bc2f-ee39-426d-9815-caf09e6103af tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:18.721549 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8409bc2f-ee39-426d-9815-caf09e6103af tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:18.721992 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8409bc2f-ee39-426d-9815-caf09e6103af tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:18.725042 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8409bc2f-ee39-426d-9815-caf09e6103af tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:18.725042 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8409bc2f-ee39-426d-9815-caf09e6103af tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:18.866728 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-8409bc2f-ee39-426d-9815-caf09e6103af tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:18.876284 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-8409bc2f-ee39-426d-9815-caf09e6103af tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15" status: 200 len: 1362 microversion: 2.1 time: 0.167672 Jul 12 14:45:18.876875 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 370/739] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:18 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:19.709282 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-5c0fd04b-6282-4b6b-8cc1-99311990a5dd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:19.709840 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-5c0fd04b-6282-4b6b-8cc1-99311990a5dd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:19.716131 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5c0fd04b-6282-4b6b-8cc1-99311990a5dd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:19.716573 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5c0fd04b-6282-4b6b-8cc1-99311990a5dd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:19.717354 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5c0fd04b-6282-4b6b-8cc1-99311990a5dd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:19.717784 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5c0fd04b-6282-4b6b-8cc1-99311990a5dd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:19.851823 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-5c0fd04b-6282-4b6b-8cc1-99311990a5dd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:19.859361 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-5c0fd04b-6282-4b6b-8cc1-99311990a5dd tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.153953 Jul 12 14:45:19.859922 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 370/740] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:19 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:19.892818 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-ec9220e2-9934-4da4-a49c-4a9b9df76562 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:19.893482 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-ec9220e2-9934-4da4-a49c-4a9b9df76562 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:19.899995 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ec9220e2-9934-4da4-a49c-4a9b9df76562 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:19.900455 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ec9220e2-9934-4da4-a49c-4a9b9df76562 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:19.901227 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ec9220e2-9934-4da4-a49c-4a9b9df76562 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:19.901667 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ec9220e2-9934-4da4-a49c-4a9b9df76562 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:20.030985 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-ec9220e2-9934-4da4-a49c-4a9b9df76562 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:20.038498 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-ec9220e2-9934-4da4-a49c-4a9b9df76562 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15" status: 200 len: 1362 microversion: 2.1 time: 0.149531 Jul 12 14:45:20.039061 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 371/741] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:19 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:20.876133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-846870f4-357d-48ef-a356-a7d22e74b106 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:20.876834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-846870f4-357d-48ef-a356-a7d22e74b106 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:20.884058 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-846870f4-357d-48ef-a356-a7d22e74b106 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:20.884516 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-846870f4-357d-48ef-a356-a7d22e74b106 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:20.885506 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-846870f4-357d-48ef-a356-a7d22e74b106 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:20.885953 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-846870f4-357d-48ef-a356-a7d22e74b106 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:21.060325 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-8d287a83-0f35-469b-8f1f-f515d3e3fb15 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:21.060946 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-8d287a83-0f35-469b-8f1f-f515d3e3fb15 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:21.068351 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8d287a83-0f35-469b-8f1f-f515d3e3fb15 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:21.069201 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8d287a83-0f35-469b-8f1f-f515d3e3fb15 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:21.070039 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8d287a83-0f35-469b-8f1f-f515d3e3fb15 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:21.070548 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8d287a83-0f35-469b-8f1f-f515d3e3fb15 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:21.096923 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-846870f4-357d-48ef-a356-a7d22e74b106 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:21.111129 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-846870f4-357d-48ef-a356-a7d22e74b106 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1522 microversion: 2.1 time: 0.238886 Jul 12 14:45:21.113197 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 371/742] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:20 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:21.245790 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-8d287a83-0f35-469b-8f1f-f515d3e3fb15 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:21.254181 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-8d287a83-0f35-469b-8f1f-f515d3e3fb15 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15" status: 200 len: 1362 microversion: 2.1 time: 0.201655 Jul 12 14:45:21.254743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 372/743] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:21 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:21.367676 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-e856a4d6-bfb9-44f6-9b4d-ae76d79f09cf req-8d445c8d-bc65-46b3-a683-e975f459a1de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e8ad66c-747a-4266-9452-a45bfeefa6c7", "name": "network-vif-deleted", "tag": "fc527dbc-5958-4a00-a992-5b997bbfade2"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:45:21.376021 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-e856a4d6-bfb9-44f6-9b4d-ae76d79f09cf req-8d445c8d-bc65-46b3-a683-e975f459a1de service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:21.376456 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-e856a4d6-bfb9-44f6-9b4d-ae76d79f09cf req-8d445c8d-bc65-46b3-a683-e975f459a1de service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:21.388928 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-e856a4d6-bfb9-44f6-9b4d-ae76d79f09cf req-8d445c8d-bc65-46b3-a683-e975f459a1de service nova] Creating event network-vif-deleted:fc527dbc-5958-4a00-a992-5b997bbfade2 for instance 2e8ad66c-747a-4266-9452-a45bfeefa6c7 on hv-cinder-82002 Jul 12 14:45:21.393822 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-e856a4d6-bfb9-44f6-9b4d-ae76d79f09cf req-8d445c8d-bc65-46b3-a683-e975f459a1de service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029849 Jul 12 14:45:21.394418 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 372/744] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:45:22.128379 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-71823e4f-f6a7-4616-9f02-c2f3eec6cc79 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:22.128988 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-71823e4f-f6a7-4616-9f02-c2f3eec6cc79 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:22.135461 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-71823e4f-f6a7-4616-9f02-c2f3eec6cc79 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:22.135907 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-71823e4f-f6a7-4616-9f02-c2f3eec6cc79 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:22.136698 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-71823e4f-f6a7-4616-9f02-c2f3eec6cc79 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:22.137146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-71823e4f-f6a7-4616-9f02-c2f3eec6cc79 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:22.199767 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-71823e4f-f6a7-4616-9f02-c2f3eec6cc79 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:22.207916 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-71823e4f-f6a7-4616-9f02-c2f3eec6cc79 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1480 microversion: 2.1 time: 0.083756 Jul 12 14:45:22.208481 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 373/745] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:22 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1480 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:22.272737 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-fe2b11ce-2539-433f-9a59-493650e414f5 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:22.273452 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-fe2b11ce-2539-433f-9a59-493650e414f5 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:22.279781 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fe2b11ce-2539-433f-9a59-493650e414f5 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:22.280250 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fe2b11ce-2539-433f-9a59-493650e414f5 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:22.281036 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fe2b11ce-2539-433f-9a59-493650e414f5 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:22.281535 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fe2b11ce-2539-433f-9a59-493650e414f5 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:22.421233 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-fe2b11ce-2539-433f-9a59-493650e414f5 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:22.428723 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-fe2b11ce-2539-433f-9a59-493650e414f5 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15" status: 200 len: 1362 microversion: 2.1 time: 0.161364 Jul 12 14:45:22.429722 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 373/746] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:22 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:23.225125 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-a5d7c209-a926-48d9-9f55-3abc77753ae4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:23.225827 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-a5d7c209-a926-48d9-9f55-3abc77753ae4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:23.227680 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell0:SELECT=6 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:23.233006 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a5d7c209-a926-48d9-9f55-3abc77753ae4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:23.233484 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a5d7c209-a926-48d9-9f55-3abc77753ae4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:23.234240 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a5d7c209-a926-48d9-9f55-3abc77753ae4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:23.234672 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a5d7c209-a926-48d9-9f55-3abc77753ae4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:23.271095 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a5d7c209-a926-48d9-9f55-3abc77753ae4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:23.271534 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a5d7c209-a926-48d9-9f55-3abc77753ae4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:23.271974 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.objects.instance [None req-a5d7c209-a926-48d9-9f55-3abc77753ae4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lazy-loading 'fault' on Instance uuid 2e8ad66c-747a-4266-9452-a45bfeefa6c7 {{(pid=129981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:45:23.314262 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-a5d7c209-a926-48d9-9f55-3abc77753ae4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f1b1e52a984639a504441e3701b981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2b01873d92453599763e5523a862f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:23.322142 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-a5d7c209-a926-48d9-9f55-3abc77753ae4 tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 200 len: 1312 microversion: 2.1 time: 0.100870 Jul 12 14:45:23.322702 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 374/747] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:23 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:23.446934 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-4305a196-0d5d-4f66-822a-ec5bf18c27d9 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:23.447558 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-4305a196-0d5d-4f66-822a-ec5bf18c27d9 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:23.450886 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell0:SELECT=2 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:23.451824 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell0:SELECT=10 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:23.452929 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=4 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:23.457090 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4305a196-0d5d-4f66-822a-ec5bf18c27d9 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:23.457590 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4305a196-0d5d-4f66-822a-ec5bf18c27d9 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:23.458830 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4305a196-0d5d-4f66-822a-ec5bf18c27d9 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:23.459429 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4305a196-0d5d-4f66-822a-ec5bf18c27d9 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:23.592792 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-4305a196-0d5d-4f66-822a-ec5bf18c27d9 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:23.600328 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-4305a196-0d5d-4f66-822a-ec5bf18c27d9 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15" status: 200 len: 1362 microversion: 2.1 time: 0.157920 Jul 12 14:45:23.600912 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 374/748] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:23 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:24.339841 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-de962429-23cc-47f5-a2ff-4ca9156df00e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:24.340663 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-de962429-23cc-47f5-a2ff-4ca9156df00e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] [instance: 2e8ad66c-747a-4266-9452-a45bfeefa6c7] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:24.347191 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-de962429-23cc-47f5-a2ff-4ca9156df00e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:24.347899 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-de962429-23cc-47f5-a2ff-4ca9156df00e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:24.348876 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-de962429-23cc-47f5-a2ff-4ca9156df00e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:24.349354 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-de962429-23cc-47f5-a2ff-4ca9156df00e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:24.363505 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.wsgi [None req-de962429-23cc-47f5-a2ff-4ca9156df00e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] HTTP exception thrown: Instance 2e8ad66c-747a-4266-9452-a45bfeefa6c7 could not be found. Jul 12 14:45:24.365207 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-de962429-23cc-47f5-a2ff-4ca9156df00e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Request method failure captured: Jul 12 14:45:24.365207 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 HTTP/1.1 Jul 12 14:45:24.365207 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:45:24.365207 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:45:24.365207 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:45:24.365207 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 0 Jul 12 14:45:24.365207 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:45:24.365207 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:45:24.365207 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:45:24.365207 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:45:24.365207 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYehYws4HrgGrv1QXrmsu2xWw8GXYW-BydE4l3b7e715YjEfH2g10AAcubc3F8Fua7xKtXboov3Y2Z32aGrkzrkDds152RTIhjLssnjoz683AGXZ-ffmMw8OOKRJ4-u7WEcb8UqTTsJ21R318wN3uwczHyiupKx-Uh53TY_6T4OsmzU Jul 12 14:45:24.365207 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:45:24.365207 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:45:24.365207 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:45:24.365207 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:45:24.365207 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:45:24.365207 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:45:24.365207 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: fe2b01873d92453599763e5523a862f8 Jul 12 14:45:24.365207 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-241601666 Jul 12 14:45:24.365207 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:45:24.365207 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:45:24.366532 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fe2b01873d92453599763e5523a862f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fe2b01873d92453599763e5523a862f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fe2b01873d92453599763e5523a862f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fe2b01873d92453599763e5523a862f8", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:45:24.366532 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-ServerRescueNegativeTestJSON-241601666 Jul 12 14:45:24.366532 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: fe2b01873d92453599763e5523a862f8 Jul 12 14:45:24.366532 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-241601666 Jul 12 14:45:24.366532 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-ServerRescueNegativeTestJSON-241601666-project Jul 12 14:45:24.366532 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:45:24.366532 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:45:24.366532 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: 97f1b1e52a984639a504441e3701b981 Jul 12 14:45:24.366532 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-ServerRescueNegativeTestJSON-241601666-project Jul 12 14:45:24.366532 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: > Jul 12 14:45:24.366532 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Instance 2e8ad66c-747a-4266-9452-a45bfeefa6c7 could not be found. Jul 12 14:45:24.366532 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'id': '2e8ad66c-747a-4266-9452-a45bfeefa6c7'} Jul 12 14:45:24.367486 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:45:24.367486 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:45:24.367486 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:45:24.367486 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:45:24.367486 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:45:24.367486 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:45:24.367486 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:45:24.367486 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:45:24.367486 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:45:24.367486 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:45:24.367486 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e8ad66c-747a-4266-9452-a45bfeefa6c7 could not be found. Jul 12 14:45:24.367486 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:45:24.367486 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:45:24.367486 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:45:24.367486 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:45:24.367486 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:45:24.367486 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:45:24.367486 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:45:24.367486 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:45:24.367486 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:45:24.369034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:45:24.369034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:45:24.369034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:45:24.369034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:45:24.369034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:45:24.369034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:45:24.369034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:45:24.369034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e8ad66c-747a-4266-9452-a45bfeefa6c7 could not be found. Jul 12 14:45:24.369034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:45:24.369034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:45:24.369034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:45:24.369034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:45:24.369034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:45:24.369034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:45:24.369034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:45:24.369034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:45:24.369034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e8ad66c-747a-4266-9452-a45bfeefa6c7 could not be found. Jul 12 14:45:24.369034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:45:24.370753 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-de962429-23cc-47f5-a2ff-4ca9156df00e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] Returning 404 to user: Instance 2e8ad66c-747a-4266-9452-a45bfeefa6c7 could not be found. {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:45:24.370753 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-de962429-23cc-47f5-a2ff-4ca9156df00e tempest-ServerRescueNegativeTestJSON-241601666 tempest-ServerRescueNegativeTestJSON-241601666-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7" status: 404 len: 111 microversion: 2.1 time: 0.030786 Jul 12 14:45:24.370753 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 375/749] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:24 2022] GET /compute/v2.1/servers/2e8ad66c-747a-4266-9452-a45bfeefa6c7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:45:24.616966 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-302213da-f35d-45d3-9b45-d210e0941851 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:24.617750 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-302213da-f35d-45d3-9b45-d210e0941851 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:24.630577 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-302213da-f35d-45d3-9b45-d210e0941851 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:24.631029 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-302213da-f35d-45d3-9b45-d210e0941851 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:24.631809 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-302213da-f35d-45d3-9b45-d210e0941851 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:24.632244 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-302213da-f35d-45d3-9b45-d210e0941851 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:24.843645 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-302213da-f35d-45d3-9b45-d210e0941851 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:24.850995 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-302213da-f35d-45d3-9b45-d210e0941851 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15" status: 200 len: 1362 microversion: 2.1 time: 0.237927 Jul 12 14:45:24.851556 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 375/750] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:24 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:25.868051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-75346249-d6e0-4316-8c91-8fd9383f101f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:25.868664 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-75346249-d6e0-4316-8c91-8fd9383f101f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:25.876893 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-75346249-d6e0-4316-8c91-8fd9383f101f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:25.877538 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-75346249-d6e0-4316-8c91-8fd9383f101f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:25.878182 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-75346249-d6e0-4316-8c91-8fd9383f101f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:25.878798 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-75346249-d6e0-4316-8c91-8fd9383f101f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:25.980345 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-03f393d1-86a7-4ac1-9438-1d6bea2a801e req-c1c91403-b2ad-46e0-b0ed-7164d659da26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "059eea39-a5fd-4428-8c51-5548bc8b0e15", "name": "network-vif-plugged", "status": "completed", "tag": "ff00788d-9218-4980-97fc-18cd7b346c4a"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:45:25.988529 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-03f393d1-86a7-4ac1-9438-1d6bea2a801e req-c1c91403-b2ad-46e0-b0ed-7164d659da26 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:25.988978 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-03f393d1-86a7-4ac1-9438-1d6bea2a801e req-c1c91403-b2ad-46e0-b0ed-7164d659da26 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:26.001304 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-03f393d1-86a7-4ac1-9438-1d6bea2a801e req-c1c91403-b2ad-46e0-b0ed-7164d659da26 service nova] Creating event network-vif-plugged:ff00788d-9218-4980-97fc-18cd7b346c4a for instance 059eea39-a5fd-4428-8c51-5548bc8b0e15 on hv-cinder-82002 Jul 12 14:45:26.006380 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-03f393d1-86a7-4ac1-9438-1d6bea2a801e req-c1c91403-b2ad-46e0-b0ed-7164d659da26 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093601 Jul 12 14:45:26.006956 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 376/751] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:45:26.108696 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-75346249-d6e0-4316-8c91-8fd9383f101f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:26.121540 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-75346249-d6e0-4316-8c91-8fd9383f101f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15" status: 200 len: 1362 microversion: 2.1 time: 0.257416 Jul 12 14:45:26.123377 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 376/752] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:25 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:27.140171 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-8f2c1028-0976-42f6-a355-04742a914b50 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:27.144975 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-8f2c1028-0976-42f6-a355-04742a914b50 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:27.152095 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8f2c1028-0976-42f6-a355-04742a914b50 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:27.152552 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8f2c1028-0976-42f6-a355-04742a914b50 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:27.153361 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8f2c1028-0976-42f6-a355-04742a914b50 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:27.153803 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8f2c1028-0976-42f6-a355-04742a914b50 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:27.288043 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-8f2c1028-0976-42f6-a355-04742a914b50 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:27.295550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-8f2c1028-0976-42f6-a355-04742a914b50 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15" status: 200 len: 1362 microversion: 2.1 time: 0.160239 Jul 12 14:45:27.297379 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 377/753] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:27 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:28.312968 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-1af8776d-3d3f-449b-9d52-30ec0aa8b360 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:28.314144 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-1af8776d-3d3f-449b-9d52-30ec0aa8b360 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:28.321388 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1af8776d-3d3f-449b-9d52-30ec0aa8b360 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:28.322123 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1af8776d-3d3f-449b-9d52-30ec0aa8b360 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:28.322619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1af8776d-3d3f-449b-9d52-30ec0aa8b360 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:28.323062 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1af8776d-3d3f-449b-9d52-30ec0aa8b360 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:28.459720 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-1af8776d-3d3f-449b-9d52-30ec0aa8b360 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:28.467196 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-1af8776d-3d3f-449b-9d52-30ec0aa8b360 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15" status: 200 len: 1362 microversion: 2.1 time: 0.158153 Jul 12 14:45:28.467762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 377/754] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:28 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:29.669034 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-d932279d-5a1a-4c63-b77b-3294d4efbeab tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:29.669034 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-d932279d-5a1a-4c63-b77b-3294d4efbeab tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:29.669034 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d932279d-5a1a-4c63-b77b-3294d4efbeab tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:29.669034 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d932279d-5a1a-4c63-b77b-3294d4efbeab tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:29.670956 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d932279d-5a1a-4c63-b77b-3294d4efbeab tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:29.670956 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d932279d-5a1a-4c63-b77b-3294d4efbeab tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:29.715968 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-d932279d-5a1a-4c63-b77b-3294d4efbeab tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:29.723728 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-d932279d-5a1a-4c63-b77b-3294d4efbeab tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15" status: 200 len: 1549 microversion: 2.1 time: 0.243907 Jul 12 14:45:29.724316 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 378/755] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:29 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 => generated 1549 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:29.746396 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-a874366f-0ab6-4521-aeab-672121232b8d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:29.746966 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-a874366f-0ab6-4521-aeab-672121232b8d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:29.760718 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a874366f-0ab6-4521-aeab-672121232b8d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:29.760718 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a874366f-0ab6-4521-aeab-672121232b8d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:29.760718 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a874366f-0ab6-4521-aeab-672121232b8d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:29.760718 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a874366f-0ab6-4521-aeab-672121232b8d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:29.879543 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-a874366f-0ab6-4521-aeab-672121232b8d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.143180 Jul 12 14:45:29.880284 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 378/756] 10.222.0.30 () {58 vars in 1274 bytes} [Tue Jul 12 14:45:29 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15/os-interface => generated 285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:45:29.998152 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-7a32ca21-90a1-4c47-8654-7219f6752a57 tempest-VolumesGetTestJSON-423181085 tempest-VolumesGetTestJSON-423181085-project] Action: 'create', calling method: .version_select at 0x7f962c9f94c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1627462345", "metadata": {"Type": "work"}}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:45:30.803761 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-7a32ca21-90a1-4c47-8654-7219f6752a57 tempest-VolumesGetTestJSON-423181085 tempest-VolumesGetTestJSON-423181085-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.925932 Jul 12 14:45:30.804433 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 379/757] 10.222.0.30 () {60 vars in 1155 bytes} [Tue Jul 12 14:45:29 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 927 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 12 14:45:30.816191 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-73e48a9a-d80c-4ef6-be30-dae94ff222e1 tempest-VolumesGetTestJSON-423181085 tempest-VolumesGetTestJSON-423181085-project] Calling method '.version_select at 0x7f962c7e0670>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:30.887596 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-73e48a9a-d80c-4ef6-be30-dae94ff222e1 tempest-VolumesGetTestJSON-423181085 tempest-VolumesGetTestJSON-423181085-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/28f2c5d1-73e9-4530-91c3-d486a689972a" status: 200 len: 353 microversion: 2.1 time: 0.073189 Jul 12 14:45:30.887596 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 379/758] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Jul 12 14:45:30 2022] GET /compute/v2.1/os-volumes/28f2c5d1-73e9-4530-91c3-d486a689972a => generated 353 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:45:31.307180 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-7a5fbe13-8de1-4c88-9a62-19e3ececba34 req-be755b24-f33e-4eb6-bb6c-90395c3df063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "059eea39-a5fd-4428-8c51-5548bc8b0e15", "tag": "ff00788d-9218-4980-97fc-18cd7b346c4a"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:45:31.316877 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-7a5fbe13-8de1-4c88-9a62-19e3ececba34 req-be755b24-f33e-4eb6-bb6c-90395c3df063 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:31.317349 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-7a5fbe13-8de1-4c88-9a62-19e3ececba34 req-be755b24-f33e-4eb6-bb6c-90395c3df063 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:31.327916 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-7a5fbe13-8de1-4c88-9a62-19e3ececba34 req-be755b24-f33e-4eb6-bb6c-90395c3df063 service nova] Creating event network-changed:ff00788d-9218-4980-97fc-18cd7b346c4a for instance 059eea39-a5fd-4428-8c51-5548bc8b0e15 on hv-cinder-82002 Jul 12 14:45:31.332963 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-7a5fbe13-8de1-4c88-9a62-19e3ececba34 req-be755b24-f33e-4eb6-bb6c-90395c3df063 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029531 Jul 12 14:45:31.333584 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 380/759] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:45:31.899743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-441c97e5-a5f9-4a74-ac34-013241ce1d71 tempest-VolumesGetTestJSON-423181085 tempest-VolumesGetTestJSON-423181085-project] Calling method '.version_select at 0x7f962c80c280>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:31.928254 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-c3fd70c9-874e-4408-be25-4a67900681e2 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1858487664", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-470070880", "security_groups": [{"name": "tempest-secgroup-smoke-137192169"}], "networks": [{"uuid": "1896320e-61e3-4e49-a6ce-745b43b67079"}], "block_device_mapping_v2": [{"uuid": "bda00094-3a9b-4523-b7f6-56dc2a7a90cc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:45:31.953856 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-441c97e5-a5f9-4a74-ac34-013241ce1d71 tempest-VolumesGetTestJSON-423181085 tempest-VolumesGetTestJSON-423181085-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/28f2c5d1-73e9-4530-91c3-d486a689972a" status: 200 len: 354 microversion: 2.1 time: 0.058893 Jul 12 14:45:31.954602 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 380/760] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Jul 12 14:45:31 2022] GET /compute/v2.1/os-volumes/28f2c5d1-73e9-4530-91c3-d486a689972a => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:45:31.967819 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-cfc860e5-5ab1-4f52-8327-128ed2d2cc38 tempest-VolumesGetTestJSON-423181085 tempest-VolumesGetTestJSON-423181085-project] Calling method '.version_select at 0x7f962c816700>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:32.019008 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-cfc860e5-5ab1-4f52-8327-128ed2d2cc38 tempest-VolumesGetTestJSON-423181085 tempest-VolumesGetTestJSON-423181085-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/28f2c5d1-73e9-4530-91c3-d486a689972a" status: 200 len: 354 microversion: 2.1 time: 0.055240 Jul 12 14:45:32.019805 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 381/761] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Jul 12 14:45:31 2022] GET /compute/v2.1/os-volumes/28f2c5d1-73e9-4530-91c3-d486a689972a => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:45:32.031413 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-768380d7-bbd4-479e-9b00-c8e9971faa25 tempest-VolumesGetTestJSON-423181085 tempest-VolumesGetTestJSON-423181085-project] Calling method '.version_select at 0x7f962c80c280>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:32.064463 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.network.neutron [None req-c3fd70c9-874e-4408-be25-4a67900681e2 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] validate_networks() for [('1896320e-61e3-4e49-a6ce-745b43b67079', None, None, None, None, None)] {{(pid=129980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:45:32.270974 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-768380d7-bbd4-479e-9b00-c8e9971faa25 tempest-VolumesGetTestJSON-423181085 tempest-VolumesGetTestJSON-423181085-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/28f2c5d1-73e9-4530-91c3-d486a689972a" status: 202 len: 0 microversion: 2.1 time: 0.243342 Jul 12 14:45:32.271555 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 382/762] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Jul 12 14:45:32 2022] DELETE /compute/v2.1/os-volumes/28f2c5d1-73e9-4530-91c3-d486a689972a => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:45:32.279824 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-b5220a60-2548-418e-8f24-428d1b183783 tempest-VolumesGetTestJSON-423181085 tempest-VolumesGetTestJSON-423181085-project] Calling method '.version_select at 0x7f962cb06430>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:32.339697 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-b5220a60-2548-418e-8f24-428d1b183783 tempest-VolumesGetTestJSON-423181085 tempest-VolumesGetTestJSON-423181085-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/28f2c5d1-73e9-4530-91c3-d486a689972a" status: 200 len: 353 microversion: 2.1 time: 0.058144 Jul 12 14:45:32.339697 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 383/763] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Jul 12 14:45:32 2022] GET /compute/v2.1/os-volumes/28f2c5d1-73e9-4530-91c3-d486a689972a => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:45:32.465800 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-c3fd70c9-874e-4408-be25-4a67900681e2 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Flavor limits 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:45:32.466224 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-c3fd70c9-874e-4408-be25-4a67900681e2 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Image limits 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:45:32.466697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-c3fd70c9-874e-4408-be25-4a67900681e2 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Flavor pref 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:45:32.467105 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-c3fd70c9-874e-4408-be25-4a67900681e2 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Image pref 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:45:32.467546 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-c3fd70c9-874e-4408-be25-4a67900681e2 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:45:32.476713 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c3fd70c9-874e-4408-be25-4a67900681e2 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:32.480237 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c3fd70c9-874e-4408-be25-4a67900681e2 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:32.480237 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c3fd70c9-874e-4408-be25-4a67900681e2 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:32.480237 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c3fd70c9-874e-4408-be25-4a67900681e2 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:32.495004 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-c3fd70c9-874e-4408-be25-4a67900681e2 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Getting quotas for project 8fa20247a7af46d0b9660d4cd026f552. Resources: {'instances', 'cores', 'ram'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:45:32.499047 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-c3fd70c9-874e-4408-be25-4a67900681e2 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Getting quotas for user df735fc7405643f285f529ddfa611064 and project 8fa20247a7af46d0b9660d4cd026f552. Resources: {'instances', 'cores', 'ram'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:45:32.557549 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-c3fd70c9-874e-4408-be25-4a67900681e2 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Going to run 1 instances... {{(pid=129980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:45:32.559732 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-c3fd70c9-874e-4408-be25-4a67900681e2 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bda00094-3a9b-4523-b7f6-56dc2a7a90cc',volume_size=None,volume_type=None)] {{(pid=129980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:45:32.968348 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-c3fd70c9-874e-4408-be25-4a67900681e2 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.044674 Jul 12 14:45:32.969295 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 381/764] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Jul 12 14:45:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 14:45:32.979943 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-2a0b0f98-6eaa-4177-875e-3e04efc0baa1 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:32.980552 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-2a0b0f98-6eaa-4177-875e-3e04efc0baa1 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:33.035352 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-2a0b0f98-6eaa-4177-875e-3e04efc0baa1 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:33.042111 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-2a0b0f98-6eaa-4177-875e-3e04efc0baa1 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1088 microversion: 2.1 time: 0.066432 Jul 12 14:45:33.042877 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 384/765] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:32 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1088 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:33.345497 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-8d22b7cd-145f-4625-b4fc-3be586e05c89 tempest-VolumesGetTestJSON-423181085 tempest-VolumesGetTestJSON-423181085-project] Calling method '.version_select at 0x7f962ca268b0>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:33.374828 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.wsgi [None req-8d22b7cd-145f-4625-b4fc-3be586e05c89 tempest-VolumesGetTestJSON-423181085 tempest-VolumesGetTestJSON-423181085-project] HTTP exception thrown: Volume 28f2c5d1-73e9-4530-91c3-d486a689972a could not be found. Jul 12 14:45:33.378504 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-8d22b7cd-145f-4625-b4fc-3be586e05c89 tempest-VolumesGetTestJSON-423181085 tempest-VolumesGetTestJSON-423181085-project] Request method failure captured: Jul 12 14:45:33.378504 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: request: GET /compute/v2.1/os-volumes/28f2c5d1-73e9-4530-91c3-d486a689972a HTTP/1.1 Jul 12 14:45:33.378504 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept: application/json Jul 12 14:45:33.378504 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept-Encoding: identity Jul 12 14:45:33.378504 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Connection: close Jul 12 14:45:33.378504 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Length: 0 Jul 12 14:45:33.378504 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Type: application/json Jul 12 14:45:33.378504 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Host: 10.222.0.30 Jul 12 14:45:33.378504 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Openstack-System-Scope: None Jul 12 14:45:33.378504 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: User-Agent: python-urllib3/1.26.9 Jul 12 14:45:33.378504 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Auth-Token: gAAAAABizYkJpTDWSLXNhTH7m_iJzeVoM1Mv_Qtns4-Q8yFcZrIkE6kQwajKOo-nehNDIQ-rY4spISQkQXKA2eLNAx0z6BxtEjqAvQpuqItLMF8JsWqEKfg1VFMCiY0mbzMZAD_Hf4zQVH5E6NBfLbN3V-DDs303Tgyvk-PRclgOMLkBaHdWXtg Jul 12 14:45:33.378504 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Id: None Jul 12 14:45:33.378504 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Name: None Jul 12 14:45:33.378504 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Identity-Status: Confirmed Jul 12 14:45:33.378504 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Is-Admin-Project: True Jul 12 14:45:33.378504 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Id: default Jul 12 14:45:33.378504 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Name: Default Jul 12 14:45:33.378504 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Id: a285734c876649f89a753f86795e24c4 Jul 12 14:45:33.378504 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Name: tempest-VolumesGetTestJSON-423181085 Jul 12 14:45:33.378504 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Role: member,reader Jul 12 14:45:33.378504 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Roles: member,reader Jul 12 14:45:33.380376 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a285734c876649f89a753f86795e24c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a285734c876649f89a753f86795e24c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a285734c876649f89a753f86795e24c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a285734c876649f89a753f86795e24c4", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:45:33.380376 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant: tempest-VolumesGetTestJSON-423181085 Jul 12 14:45:33.380376 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Id: a285734c876649f89a753f86795e24c4 Jul 12 14:45:33.380376 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Name: tempest-VolumesGetTestJSON-423181085 Jul 12 14:45:33.380376 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User: tempest-VolumesGetTestJSON-423181085-project Jul 12 14:45:33.380376 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Id: default Jul 12 14:45:33.380376 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Name: Default Jul 12 14:45:33.380376 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Id: 3ca554e3e0604d619934ef9c00b3aa9b Jul 12 14:45:33.380376 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Name: tempest-VolumesGetTestJSON-423181085-project Jul 12 14:45:33.380376 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: method: Jul 12 14:45:33.380376 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: exception: Volume 28f2c5d1-73e9-4530-91c3-d486a689972a could not be found. Jul 12 14:45:33.380376 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: action_args: {'id': '28f2c5d1-73e9-4530-91c3-d486a689972a'} Jul 12 14:45:33.380376 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:45:33.381487 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:45:33.381487 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 14:45:33.381487 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 14:45:33.381487 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 14:45:33.381487 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 14:45:33.381487 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 14:45:33.381487 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 14:45:33.381487 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 14:45:33.381487 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 14:45:33.381487 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 14:45:33.381487 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 14:45:33.381487 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:45:33.381487 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:45:33.381487 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:45:33.381487 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:45:33.381487 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 28f2c5d1-73e9-4530-91c3-d486a689972a could not be found. (HTTP 404) (Request-ID: req-20c579df-40a2-4f1f-a118-bfdd423df974) Jul 12 14:45:33.381487 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:45:33.381487 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:45:33.381487 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:45:33.383067 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:45:33.383067 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 14:45:33.383067 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 14:45:33.383067 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 14:45:33.383067 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 14:45:33.383067 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 14:45:33.383067 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 14:45:33.383067 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 14:45:33.383067 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 14:45:33.383067 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 14:45:33.383067 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 14:45:33.383067 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 14:45:33.383067 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 14:45:33.383067 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 14:45:33.383067 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 14:45:33.383067 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 14:45:33.383067 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 14:45:33.383067 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 14:45:33.383067 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 14:45:33.384660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:45:33.384660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:45:33.384660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:45:33.384660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:45:33.384660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 28f2c5d1-73e9-4530-91c3-d486a689972a could not be found. Jul 12 14:45:33.384660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:45:33.384660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:45:33.384660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:45:33.384660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:45:33.384660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:45:33.384660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:45:33.384660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:45:33.384660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:45:33.384660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 14:45:33.384660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 14:45:33.384660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:45:33.384660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:45:33.384660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 14:45:33.384660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:45:33.386915 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 28f2c5d1-73e9-4530-91c3-d486a689972a could not be found. Jul 12 14:45:33.386915 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:45:33.386915 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:45:33.386915 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:45:33.386915 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:45:33.386915 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:45:33.386915 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:45:33.386915 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:45:33.386915 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:45:33.386915 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 28f2c5d1-73e9-4530-91c3-d486a689972a could not be found. Jul 12 14:45:33.386915 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:45:33.386915 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-8d22b7cd-145f-4625-b4fc-3be586e05c89 tempest-VolumesGetTestJSON-423181085 tempest-VolumesGetTestJSON-423181085-project] Returning 404 to user: Volume 28f2c5d1-73e9-4530-91c3-d486a689972a could not be found. {{(pid=129980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:45:33.386915 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-8d22b7cd-145f-4625-b4fc-3be586e05c89 tempest-VolumesGetTestJSON-423181085 tempest-VolumesGetTestJSON-423181085-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/28f2c5d1-73e9-4530-91c3-d486a689972a" status: 404 len: 109 microversion: 2.1 time: 0.036994 Jul 12 14:45:33.386915 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 382/766] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Jul 12 14:45:33 2022] GET /compute/v2.1/os-volumes/28f2c5d1-73e9-4530-91c3-d486a689972a => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:45:34.059299 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-ea470b4e-6394-434f-b2eb-88cc4f7ec5f8 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:34.060091 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-ea470b4e-6394-434f-b2eb-88cc4f7ec5f8 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:34.068391 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ea470b4e-6394-434f-b2eb-88cc4f7ec5f8 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:34.068874 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ea470b4e-6394-434f-b2eb-88cc4f7ec5f8 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:34.069678 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ea470b4e-6394-434f-b2eb-88cc4f7ec5f8 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:34.070118 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ea470b4e-6394-434f-b2eb-88cc4f7ec5f8 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:34.133421 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-ea470b4e-6394-434f-b2eb-88cc4f7ec5f8 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:34.142639 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-ea470b4e-6394-434f-b2eb-88cc4f7ec5f8 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1138 microversion: 2.1 time: 0.085994 Jul 12 14:45:34.142639 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 385/767] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:34 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1138 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:45:35.158662 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-f31b4324-facb-4fb4-9379-c66f42c32027 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:35.160051 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-f31b4324-facb-4fb4-9379-c66f42c32027 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:35.168177 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f31b4324-facb-4fb4-9379-c66f42c32027 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:35.168636 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f31b4324-facb-4fb4-9379-c66f42c32027 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:35.169538 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f31b4324-facb-4fb4-9379-c66f42c32027 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:35.169871 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f31b4324-facb-4fb4-9379-c66f42c32027 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:35.174459 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:35.244726 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-f31b4324-facb-4fb4-9379-c66f42c32027 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:35.253339 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-f31b4324-facb-4fb4-9379-c66f42c32027 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1194 microversion: 2.1 time: 0.098619 Jul 12 14:45:35.254518 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 383/768] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:35 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1194 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:35.760479 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e6c24406-67e5-4da2-863e-da6e72622451 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:35.760994 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-e6c24406-67e5-4da2-863e-da6e72622451 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:35.763449 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:35.768366 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e6c24406-67e5-4da2-863e-da6e72622451 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:35.769411 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e6c24406-67e5-4da2-863e-da6e72622451 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:35.770233 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e6c24406-67e5-4da2-863e-da6e72622451 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:35.770737 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e6c24406-67e5-4da2-863e-da6e72622451 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:35.796465 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-e6c24406-67e5-4da2-863e-da6e72622451 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586/ips" status: 200 len: 151 microversion: 2.20 time: 0.039986 Jul 12 14:45:35.797138 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 386/769] 10.222.0.30 () {60 vars in 1288 bytes} [Tue Jul 12 14:45:35 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:45:36.281868 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-e36736d2-230c-4dab-9be7-2e974570ad2b tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:36.282596 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-e36736d2-230c-4dab-9be7-2e974570ad2b tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:36.291924 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e36736d2-230c-4dab-9be7-2e974570ad2b tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:36.294241 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e36736d2-230c-4dab-9be7-2e974570ad2b tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:36.294457 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e36736d2-230c-4dab-9be7-2e974570ad2b tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:36.296248 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e36736d2-230c-4dab-9be7-2e974570ad2b tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:36.532742 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-e36736d2-230c-4dab-9be7-2e974570ad2b tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:36.540329 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-e36736d2-230c-4dab-9be7-2e974570ad2b tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1271 microversion: 2.1 time: 0.273175 Jul 12 14:45:36.540832 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 384/770] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:36 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1271 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:37.124250 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-24609d2f-f896-4450-be01-e5a93ed7b010 req-3ccc1df2-549d-4e40-ab7c-cfb63a383bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "336f3e15-d106-4a54-b655-49328b81248d", "tag": "07cdb948-262b-44e3-a60e-ac8f1916b818"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:45:37.136113 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-24609d2f-f896-4450-be01-e5a93ed7b010 req-3ccc1df2-549d-4e40-ab7c-cfb63a383bf3 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:37.136803 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-24609d2f-f896-4450-be01-e5a93ed7b010 req-3ccc1df2-549d-4e40-ab7c-cfb63a383bf3 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:37.150730 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-24609d2f-f896-4450-be01-e5a93ed7b010 req-3ccc1df2-549d-4e40-ab7c-cfb63a383bf3 service nova] Creating event network-changed:07cdb948-262b-44e3-a60e-ac8f1916b818 for instance 336f3e15-d106-4a54-b655-49328b81248d on hv-cinder-82002 Jul 12 14:45:37.159193 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-24609d2f-f896-4450-be01-e5a93ed7b010 req-3ccc1df2-549d-4e40-ab7c-cfb63a383bf3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039104 Jul 12 14:45:37.159193 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 387/771] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:45:37.420457 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-db5e3909-374b-405c-a177-1f333c40d3db tempest-VolumesTestJSON-1601176532 tempest-VolumesTestJSON-1601176532-project] Calling method '.version_select at 0x7f962c9ec310>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:37.473150 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-db5e3909-374b-405c-a177-1f333c40d3db tempest-VolumesTestJSON-1601176532 tempest-VolumesTestJSON-1601176532-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/f23fd5c0-42d0-4d1c-b890-b0da4cacecbf" status: 200 len: 351 microversion: 2.1 time: 0.056396 Jul 12 14:45:37.473834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 385/772] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Jul 12 14:45:37 2022] GET /compute/v2.1/os-volumes/f23fd5c0-42d0-4d1c-b890-b0da4cacecbf => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:45:37.558750 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-b0d71b96-3715-45b0-a397-dbd056f355ea tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:37.559687 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-b0d71b96-3715-45b0-a397-dbd056f355ea tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:37.567379 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b0d71b96-3715-45b0-a397-dbd056f355ea tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:37.567951 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b0d71b96-3715-45b0-a397-dbd056f355ea tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:37.568801 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b0d71b96-3715-45b0-a397-dbd056f355ea tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:37.569367 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b0d71b96-3715-45b0-a397-dbd056f355ea tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:37.809004 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-b0d71b96-3715-45b0-a397-dbd056f355ea tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:37.816595 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-b0d71b96-3715-45b0-a397-dbd056f355ea tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1259 microversion: 2.1 time: 0.261958 Jul 12 14:45:37.817316 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 388/773] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:37 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1259 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:38.279859 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-96b8ba1a-8b05-4107-8b68-d100c7ad4cc8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:45:38.280316 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-96b8ba1a-8b05-4107-8b68-d100c7ad4cc8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:38.286953 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-96b8ba1a-8b05-4107-8b68-d100c7ad4cc8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:38.290636 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-96b8ba1a-8b05-4107-8b68-d100c7ad4cc8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:38.290636 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-96b8ba1a-8b05-4107-8b68-d100c7ad4cc8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:38.290636 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-96b8ba1a-8b05-4107-8b68-d100c7ad4cc8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:38.312047 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.objects.instance [None req-96b8ba1a-8b05-4107-8b68-d100c7ad4cc8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lazy-loading 'flavor' on Instance uuid 80951178-6d64-4856-a450-a1e1b64c2586 {{(pid=129980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:45:38.834824 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-82b50ed7-6dbc-47c5-bb92-2bab0780895f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:38.835462 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-82b50ed7-6dbc-47c5-bb92-2bab0780895f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:38.841877 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-82b50ed7-6dbc-47c5-bb92-2bab0780895f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:38.842331 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-82b50ed7-6dbc-47c5-bb92-2bab0780895f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:38.843094 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-82b50ed7-6dbc-47c5-bb92-2bab0780895f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:38.843527 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-82b50ed7-6dbc-47c5-bb92-2bab0780895f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:38.923357 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-96b8ba1a-8b05-4107-8b68-d100c7ad4cc8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "POST /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586/action" status: 202 len: 0 microversion: 2.20 time: 0.647299 Jul 12 14:45:38.927485 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 386/774] 10.222.0.30 () {62 vars in 1318 bytes} [Tue Jul 12 14:45:38 2022] POST /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586/action => generated 0 bytes in 649 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 12 14:45:38.934075 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-c08bf165-f235-41fd-93a0-c2e3f151b4e8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:38.935113 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-c08bf165-f235-41fd-93a0-c2e3f151b4e8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:38.942653 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c08bf165-f235-41fd-93a0-c2e3f151b4e8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:38.943231 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c08bf165-f235-41fd-93a0-c2e3f151b4e8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:38.944011 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c08bf165-f235-41fd-93a0-c2e3f151b4e8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:38.944459 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c08bf165-f235-41fd-93a0-c2e3f151b4e8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:38.978066 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-82b50ed7-6dbc-47c5-bb92-2bab0780895f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:38.986270 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-82b50ed7-6dbc-47c5-bb92-2bab0780895f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1259 microversion: 2.1 time: 0.156236 Jul 12 14:45:38.986852 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 389/775] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:38 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:45:39.085272 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-c08bf165-f235-41fd-93a0-c2e3f151b4e8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:39.093441 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-c08bf165-f235-41fd-93a0-c2e3f151b4e8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:39.094935 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-c08bf165-f235-41fd-93a0-c2e3f151b4e8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:39.096261 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-c08bf165-f235-41fd-93a0-c2e3f151b4e8 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1722 microversion: 2.20 time: 0.167333 Jul 12 14:45:39.096847 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 387/776] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:45:38 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:45:39.121886 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-f479cd9c-2055-412e-9bc1-8bce5df3dd52 tempest-VolumesTestJSON-1601176532 tempest-VolumesTestJSON-1601176532-project] Calling method '.version_select at 0x7f962c8124c0>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:39.169489 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-f479cd9c-2055-412e-9bc1-8bce5df3dd52 tempest-VolumesTestJSON-1601176532 tempest-VolumesTestJSON-1601176532-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/e91d764f-f1b7-49e2-ad0d-5d0893c46192" status: 200 len: 351 microversion: 2.1 time: 0.051355 Jul 12 14:45:39.170112 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 390/777] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Jul 12 14:45:39 2022] GET /compute/v2.1/os-volumes/e91d764f-f1b7-49e2-ad0d-5d0893c46192 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:45:40.004204 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-c131c10e-3d32-4593-8df1-130ffda4fcdf tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:40.004773 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-c131c10e-3d32-4593-8df1-130ffda4fcdf tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:40.011249 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c131c10e-3d32-4593-8df1-130ffda4fcdf tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:40.011744 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c131c10e-3d32-4593-8df1-130ffda4fcdf tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:40.012526 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c131c10e-3d32-4593-8df1-130ffda4fcdf tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:40.012947 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c131c10e-3d32-4593-8df1-130ffda4fcdf tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:40.115665 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-f46855a8-5827-4997-ad5b-1f3ebb7de03f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:40.116423 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-f46855a8-5827-4997-ad5b-1f3ebb7de03f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:40.122635 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f46855a8-5827-4997-ad5b-1f3ebb7de03f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:40.123180 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f46855a8-5827-4997-ad5b-1f3ebb7de03f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:40.124017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f46855a8-5827-4997-ad5b-1f3ebb7de03f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:40.124525 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f46855a8-5827-4997-ad5b-1f3ebb7de03f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:40.144332 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-c131c10e-3d32-4593-8df1-130ffda4fcdf tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:40.151865 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-c131c10e-3d32-4593-8df1-130ffda4fcdf tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1259 microversion: 2.1 time: 0.152311 Jul 12 14:45:40.152439 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 388/778] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:39 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:40.251944 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-f46855a8-5827-4997-ad5b-1f3ebb7de03f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:40.260441 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-f46855a8-5827-4997-ad5b-1f3ebb7de03f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:40.261913 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-f46855a8-5827-4997-ad5b-1f3ebb7de03f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:40.263057 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-f46855a8-5827-4997-ad5b-1f3ebb7de03f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1722 microversion: 2.20 time: 0.152331 Jul 12 14:45:40.263611 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 391/779] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:45:40 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:45:40.708853 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-6ad31de9-553c-4da7-a969-c3bff770fc18 tempest-VolumesTestJSON-1601176532 tempest-VolumesTestJSON-1601176532-project] Calling method '.version_select at 0x7f962ca44550>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:40.754825 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-6ad31de9-553c-4da7-a969-c3bff770fc18 tempest-VolumesTestJSON-1601176532 tempest-VolumesTestJSON-1601176532-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/64ab2502-b167-44a9-a1f5-015637e17416" status: 200 len: 350 microversion: 2.1 time: 0.049643 Jul 12 14:45:40.755504 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 389/780] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Jul 12 14:45:40 2022] GET /compute/v2.1/os-volumes/64ab2502-b167-44a9-a1f5-015637e17416 => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:45:40.766569 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-afa66fd4-8c36-4e7f-8910-d6a42e4dc10e tempest-VolumesTestJSON-1601176532 tempest-VolumesTestJSON-1601176532-project] Calling method '.version_select at 0x7f962c8123a0>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:40.846408 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-afa66fd4-8c36-4e7f-8910-d6a42e4dc10e tempest-VolumesTestJSON-1601176532 tempest-VolumesTestJSON-1601176532-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.083693 Jul 12 14:45:40.847588 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 392/781] 10.222.0.30 () {58 vars in 1133 bytes} [Tue Jul 12 14:45:40 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:40.859721 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-fac4f49e-8dab-4555-92cb-82db6f592d4a tempest-VolumesTestJSON-1601176532 tempest-VolumesTestJSON-1601176532-project] Calling method '.version_select at 0x7f963129d670>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:40.939502 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-fac4f49e-8dab-4555-92cb-82db6f592d4a tempest-VolumesTestJSON-1601176532 tempest-VolumesTestJSON-1601176532-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083480 Jul 12 14:45:40.940114 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 390/782] 10.222.0.30 () {58 vars in 1148 bytes} [Tue Jul 12 14:45:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:45:40.952034 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-3aa2e32c-3d5d-4fd7-b1d2-f18ae4d5f7cb tempest-VolumesTestJSON-1601176532 tempest-VolumesTestJSON-1601176532-project] Calling method '.version_select at 0x7f962c9659d0>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:41.036320 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-3aa2e32c-3d5d-4fd7-b1d2-f18ae4d5f7cb tempest-VolumesTestJSON-1601176532 tempest-VolumesTestJSON-1601176532-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087886 Jul 12 14:45:41.036891 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 393/783] 10.222.0.30 () {58 vars in 1133 bytes} [Tue Jul 12 14:45:40 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:41.048350 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-b63c7a65-410b-4402-8333-e08f8b496a5e tempest-VolumesTestJSON-1601176532 tempest-VolumesTestJSON-1601176532-project] Calling method '.version_select at 0x7f963129b0d0>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:41.128445 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-b63c7a65-410b-4402-8333-e08f8b496a5e tempest-VolumesTestJSON-1601176532 tempest-VolumesTestJSON-1601176532-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083634 Jul 12 14:45:41.129029 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 391/784] 10.222.0.30 () {58 vars in 1166 bytes} [Tue Jul 12 14:45:41 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:45:41.140885 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-25b619c6-309e-46f8-82c7-738ae62dcba1 tempest-VolumesTestJSON-1601176532 tempest-VolumesTestJSON-1601176532-project] Calling method '.version_select at 0x7f962c80cf70>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:41.168976 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-a0771f51-4598-4eab-b7aa-219f8272df2f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:41.169607 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-a0771f51-4598-4eab-b7aa-219f8272df2f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:41.176555 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a0771f51-4598-4eab-b7aa-219f8272df2f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:41.176943 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a0771f51-4598-4eab-b7aa-219f8272df2f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:41.177723 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a0771f51-4598-4eab-b7aa-219f8272df2f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:41.178155 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a0771f51-4598-4eab-b7aa-219f8272df2f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:41.220782 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-25b619c6-309e-46f8-82c7-738ae62dcba1 tempest-VolumesTestJSON-1601176532 tempest-VolumesTestJSON-1601176532-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.084009 Jul 12 14:45:41.221401 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 394/785] 10.222.0.30 () {58 vars in 1169 bytes} [Tue Jul 12 14:45:41 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:45:41.233557 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-7179d952-e8f6-49c2-b73b-9f347c3db7f1 tempest-VolumesTestJSON-1601176532 tempest-VolumesTestJSON-1601176532-project] Calling method '.version_select at 0x7f962c804820>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:41.312864 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-a0771f51-4598-4eab-b7aa-219f8272df2f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:41.313712 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-7179d952-e8f6-49c2-b73b-9f347c3db7f1 tempest-VolumesTestJSON-1601176532 tempest-VolumesTestJSON-1601176532-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.083682 Jul 12 14:45:41.314358 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 395/786] 10.222.0.30 () {58 vars in 1154 bytes} [Tue Jul 12 14:45:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:45:41.319826 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-6380e267-0669-461e-9bcf-a3ca206aae5f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:41.320502 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-6380e267-0669-461e-9bcf-a3ca206aae5f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:41.321392 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-a0771f51-4598-4eab-b7aa-219f8272df2f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1259 microversion: 2.1 time: 0.156101 Jul 12 14:45:41.321957 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 392/787] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:41 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:45:41.326267 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-bf0648f8-a829-4d10-9ed1-1f09d2cca8be tempest-VolumesTestJSON-1601176532 tempest-VolumesTestJSON-1601176532-project] Calling method '.version_select at 0x7f962ca2d310>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:41.327317 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6380e267-0669-461e-9bcf-a3ca206aae5f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:41.327832 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6380e267-0669-461e-9bcf-a3ca206aae5f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:41.328677 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6380e267-0669-461e-9bcf-a3ca206aae5f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:41.329190 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6380e267-0669-461e-9bcf-a3ca206aae5f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:41.406031 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-bf0648f8-a829-4d10-9ed1-1f09d2cca8be tempest-VolumesTestJSON-1601176532 tempest-VolumesTestJSON-1601176532-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.082960 Jul 12 14:45:41.406611 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 393/788] 10.222.0.30 () {58 vars in 1187 bytes} [Tue Jul 12 14:45:41 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:45:41.417764 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-00e9273b-aeea-4ab1-9870-e2fc646bcab7 tempest-VolumesTestJSON-1601176532 tempest-VolumesTestJSON-1601176532-project] Calling method '.version_select at 0x7f963129d5e0>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:41.462085 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-6380e267-0669-461e-9bcf-a3ca206aae5f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:41.470326 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-6380e267-0669-461e-9bcf-a3ca206aae5f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:41.473490 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-6380e267-0669-461e-9bcf-a3ca206aae5f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:41.474720 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-6380e267-0669-461e-9bcf-a3ca206aae5f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1722 microversion: 2.20 time: 0.159281 Jul 12 14:45:41.475281 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 396/789] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:45:41 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:45:41.504017 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-00e9273b-aeea-4ab1-9870-e2fc646bcab7 tempest-VolumesTestJSON-1601176532 tempest-VolumesTestJSON-1601176532-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.089714 Jul 12 14:45:41.504622 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 394/790] 10.222.0.30 () {58 vars in 1154 bytes} [Tue Jul 12 14:45:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:45:42.337507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-081dbdb8-240e-44e8-bae6-61741fcd3e32 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:42.338119 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-081dbdb8-240e-44e8-bae6-61741fcd3e32 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:42.344567 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-081dbdb8-240e-44e8-bae6-61741fcd3e32 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:42.345013 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-081dbdb8-240e-44e8-bae6-61741fcd3e32 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:42.345807 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-081dbdb8-240e-44e8-bae6-61741fcd3e32 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:42.346243 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-081dbdb8-240e-44e8-bae6-61741fcd3e32 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:42.486058 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-081dbdb8-240e-44e8-bae6-61741fcd3e32 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:42.489875 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell0:SELECT=2 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:42.493828 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-23fc206c-ca25-43d6-9a0a-2a67ac5189ac tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:42.494133 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-081dbdb8-240e-44e8-bae6-61741fcd3e32 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1259 microversion: 2.1 time: 0.160536 Jul 12 14:45:42.494433 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-23fc206c-ca25-43d6-9a0a-2a67ac5189ac tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:42.494709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 397/791] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:42 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:42.501475 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-23fc206c-ca25-43d6-9a0a-2a67ac5189ac tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:42.501927 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-23fc206c-ca25-43d6-9a0a-2a67ac5189ac tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:42.502880 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-23fc206c-ca25-43d6-9a0a-2a67ac5189ac tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:42.503847 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-23fc206c-ca25-43d6-9a0a-2a67ac5189ac tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:42.507750 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell0:SELECT=6 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:42.631467 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-23fc206c-ca25-43d6-9a0a-2a67ac5189ac tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:42.639355 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-23fc206c-ca25-43d6-9a0a-2a67ac5189ac tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:42.643047 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-23fc206c-ca25-43d6-9a0a-2a67ac5189ac tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:42.643047 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-23fc206c-ca25-43d6-9a0a-2a67ac5189ac tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1722 microversion: 2.20 time: 0.153510 Jul 12 14:45:42.643047 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 395/792] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:45:42 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:45:43.510941 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-f4a55f11-9bb7-4b4a-827b-5e2cbdb00c83 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:43.511547 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-f4a55f11-9bb7-4b4a-827b-5e2cbdb00c83 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:43.513603 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell0:SELECT=2 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:43.519430 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f4a55f11-9bb7-4b4a-827b-5e2cbdb00c83 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:43.519879 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f4a55f11-9bb7-4b4a-827b-5e2cbdb00c83 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:43.521383 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f4a55f11-9bb7-4b4a-827b-5e2cbdb00c83 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:43.521383 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f4a55f11-9bb7-4b4a-827b-5e2cbdb00c83 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:43.538953 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=100 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:43.654925 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-f4a55f11-9bb7-4b4a-827b-5e2cbdb00c83 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:43.661024 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-79f611d1-cfc8-49ef-b337-ce528a4fdf9e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:43.661673 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-79f611d1-cfc8-49ef-b337-ce528a4fdf9e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:43.663138 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-f4a55f11-9bb7-4b4a-827b-5e2cbdb00c83 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1259 microversion: 2.1 time: 0.156037 Jul 12 14:45:43.663893 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 398/793] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:43 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:43.668634 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-79f611d1-cfc8-49ef-b337-ce528a4fdf9e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:43.669270 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-79f611d1-cfc8-49ef-b337-ce528a4fdf9e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:43.669980 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-79f611d1-cfc8-49ef-b337-ce528a4fdf9e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:43.670421 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-79f611d1-cfc8-49ef-b337-ce528a4fdf9e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:43.807210 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-79f611d1-cfc8-49ef-b337-ce528a4fdf9e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:43.815089 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-79f611d1-cfc8-49ef-b337-ce528a4fdf9e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:43.816743 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-79f611d1-cfc8-49ef-b337-ce528a4fdf9e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:43.817918 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-79f611d1-cfc8-49ef-b337-ce528a4fdf9e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1722 microversion: 2.20 time: 0.161452 Jul 12 14:45:43.818478 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 396/794] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:45:43 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:45:44.679931 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-4522d453-881d-461d-9e5d-7d9b8d930342 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:44.680537 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-4522d453-881d-461d-9e5d-7d9b8d930342 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:44.687216 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4522d453-881d-461d-9e5d-7d9b8d930342 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:44.687658 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4522d453-881d-461d-9e5d-7d9b8d930342 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:44.688416 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4522d453-881d-461d-9e5d-7d9b8d930342 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:44.688847 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4522d453-881d-461d-9e5d-7d9b8d930342 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:44.818581 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-4522d453-881d-461d-9e5d-7d9b8d930342 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:44.826057 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-4522d453-881d-461d-9e5d-7d9b8d930342 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1259 microversion: 2.1 time: 0.150365 Jul 12 14:45:44.826626 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 399/795] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:44 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:44.836409 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-bc88a01d-891b-4fd8-a0af-7a2df72e91b7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:44.837144 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-bc88a01d-891b-4fd8-a0af-7a2df72e91b7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:44.843659 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bc88a01d-891b-4fd8-a0af-7a2df72e91b7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:44.844109 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bc88a01d-891b-4fd8-a0af-7a2df72e91b7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:44.844873 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bc88a01d-891b-4fd8-a0af-7a2df72e91b7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:44.845355 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bc88a01d-891b-4fd8-a0af-7a2df72e91b7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:44.980435 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-bc88a01d-891b-4fd8-a0af-7a2df72e91b7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:44.989275 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-bc88a01d-891b-4fd8-a0af-7a2df72e91b7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:44.991347 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-bc88a01d-891b-4fd8-a0af-7a2df72e91b7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:44.992533 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-bc88a01d-891b-4fd8-a0af-7a2df72e91b7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1722 microversion: 2.20 time: 0.159968 Jul 12 14:45:44.993088 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 397/796] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:45:44 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:45:45.848334 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-66000c44-9905-419f-a2d1-fd075a563c61 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:45.849535 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-66000c44-9905-419f-a2d1-fd075a563c61 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:45.856079 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-66000c44-9905-419f-a2d1-fd075a563c61 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:45.856531 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-66000c44-9905-419f-a2d1-fd075a563c61 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:45.857330 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-66000c44-9905-419f-a2d1-fd075a563c61 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:45.857765 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-66000c44-9905-419f-a2d1-fd075a563c61 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:45.996070 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-66000c44-9905-419f-a2d1-fd075a563c61 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:46.006834 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-66000c44-9905-419f-a2d1-fd075a563c61 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1259 microversion: 2.1 time: 0.162787 Jul 12 14:45:46.007424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 400/797] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:45 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:46.014442 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-5f0a4546-ac6a-4b95-a2c9-085fe38aec69 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:46.015399 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-5f0a4546-ac6a-4b95-a2c9-085fe38aec69 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:46.026512 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5f0a4546-ac6a-4b95-a2c9-085fe38aec69 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:46.027298 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5f0a4546-ac6a-4b95-a2c9-085fe38aec69 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:46.028633 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5f0a4546-ac6a-4b95-a2c9-085fe38aec69 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:46.029561 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5f0a4546-ac6a-4b95-a2c9-085fe38aec69 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:46.198872 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-5f0a4546-ac6a-4b95-a2c9-085fe38aec69 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:46.209725 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-5f0a4546-ac6a-4b95-a2c9-085fe38aec69 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:46.211261 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-5f0a4546-ac6a-4b95-a2c9-085fe38aec69 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:46.212442 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-5f0a4546-ac6a-4b95-a2c9-085fe38aec69 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1722 microversion: 2.20 time: 0.203300 Jul 12 14:45:46.213021 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 398/798] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:45:46 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:45:47.023701 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-0cbb2910-b700-4653-8cf7-4af613095195 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:47.024328 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-0cbb2910-b700-4653-8cf7-4af613095195 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:47.030830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0cbb2910-b700-4653-8cf7-4af613095195 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:47.031283 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0cbb2910-b700-4653-8cf7-4af613095195 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:47.032048 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0cbb2910-b700-4653-8cf7-4af613095195 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:47.032486 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0cbb2910-b700-4653-8cf7-4af613095195 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:47.167275 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-0cbb2910-b700-4653-8cf7-4af613095195 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:47.175439 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-0cbb2910-b700-4653-8cf7-4af613095195 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1259 microversion: 2.1 time: 0.154875 Jul 12 14:45:47.176009 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 401/799] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:47 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:47.231306 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0e728112-8a94-4523-b265-78b2590e7221 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:47.231915 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-0e728112-8a94-4523-b265-78b2590e7221 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:47.239016 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0e728112-8a94-4523-b265-78b2590e7221 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:47.239465 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0e728112-8a94-4523-b265-78b2590e7221 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:47.240235 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0e728112-8a94-4523-b265-78b2590e7221 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:47.240670 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0e728112-8a94-4523-b265-78b2590e7221 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:47.368319 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-0e728112-8a94-4523-b265-78b2590e7221 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:47.377081 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-0e728112-8a94-4523-b265-78b2590e7221 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:47.378811 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-0e728112-8a94-4523-b265-78b2590e7221 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:47.380059 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-0e728112-8a94-4523-b265-78b2590e7221 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1722 microversion: 2.20 time: 0.152633 Jul 12 14:45:47.380612 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 399/800] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:45:47 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:45:47.953996 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-525789c9-5f1b-4a47-ac59-8ad2d2b9c4fe req-5b339611-ce33-48c1-8ac9-f8b10db2ff8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "336f3e15-d106-4a54-b655-49328b81248d", "name": "network-vif-plugged", "status": "completed", "tag": "07cdb948-262b-44e3-a60e-ac8f1916b818"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:45:47.963483 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-525789c9-5f1b-4a47-ac59-8ad2d2b9c4fe req-5b339611-ce33-48c1-8ac9-f8b10db2ff8d service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:47.963922 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-525789c9-5f1b-4a47-ac59-8ad2d2b9c4fe req-5b339611-ce33-48c1-8ac9-f8b10db2ff8d service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:47.974776 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-525789c9-5f1b-4a47-ac59-8ad2d2b9c4fe req-5b339611-ce33-48c1-8ac9-f8b10db2ff8d service nova] Creating event network-vif-plugged:07cdb948-262b-44e3-a60e-ac8f1916b818 for instance 336f3e15-d106-4a54-b655-49328b81248d on hv-cinder-82002 Jul 12 14:45:47.979891 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-525789c9-5f1b-4a47-ac59-8ad2d2b9c4fe req-5b339611-ce33-48c1-8ac9-f8b10db2ff8d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030808 Jul 12 14:45:47.980542 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 402/801] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:45:48.195275 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-1acb2264-64ff-4bf2-84e0-c155e20f2510 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:48.196073 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-1acb2264-64ff-4bf2-84e0-c155e20f2510 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:48.205414 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1acb2264-64ff-4bf2-84e0-c155e20f2510 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:48.207031 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1acb2264-64ff-4bf2-84e0-c155e20f2510 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:48.208115 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1acb2264-64ff-4bf2-84e0-c155e20f2510 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:48.208980 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1acb2264-64ff-4bf2-84e0-c155e20f2510 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:48.359496 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-1acb2264-64ff-4bf2-84e0-c155e20f2510 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:48.367148 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-1acb2264-64ff-4bf2-84e0-c155e20f2510 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1259 microversion: 2.1 time: 0.178259 Jul 12 14:45:48.367722 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 400/802] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:48 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:48.405149 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-0ce77f63-9ae4-4c4b-9dd5-8d832242f196 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:48.405149 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-0ce77f63-9ae4-4c4b-9dd5-8d832242f196 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:48.408742 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0ce77f63-9ae4-4c4b-9dd5-8d832242f196 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:48.409815 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0ce77f63-9ae4-4c4b-9dd5-8d832242f196 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:48.410677 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0ce77f63-9ae4-4c4b-9dd5-8d832242f196 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:48.411116 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0ce77f63-9ae4-4c4b-9dd5-8d832242f196 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:48.590374 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-0ce77f63-9ae4-4c4b-9dd5-8d832242f196 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:48.600302 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-0ce77f63-9ae4-4c4b-9dd5-8d832242f196 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:48.602026 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-0ce77f63-9ae4-4c4b-9dd5-8d832242f196 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:48.603287 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-0ce77f63-9ae4-4c4b-9dd5-8d832242f196 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1722 microversion: 2.20 time: 0.207407 Jul 12 14:45:48.603863 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 403/803] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:45:48 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:45:49.384322 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0beb88e6-68e8-4991-8f0a-69200edbb1de tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:49.384883 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-0beb88e6-68e8-4991-8f0a-69200edbb1de tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:49.391321 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0beb88e6-68e8-4991-8f0a-69200edbb1de tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:49.391769 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0beb88e6-68e8-4991-8f0a-69200edbb1de tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:49.392524 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0beb88e6-68e8-4991-8f0a-69200edbb1de tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:49.392963 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0beb88e6-68e8-4991-8f0a-69200edbb1de tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:49.523271 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-0beb88e6-68e8-4991-8f0a-69200edbb1de tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:49.530749 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-0beb88e6-68e8-4991-8f0a-69200edbb1de tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1259 microversion: 2.1 time: 0.150341 Jul 12 14:45:49.531318 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 401/804] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:49 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:49.621754 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-b3735601-45f0-41bc-96e8-94200493f7c1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:49.622393 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-b3735601-45f0-41bc-96e8-94200493f7c1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:49.629136 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b3735601-45f0-41bc-96e8-94200493f7c1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:49.629611 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b3735601-45f0-41bc-96e8-94200493f7c1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:49.630372 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b3735601-45f0-41bc-96e8-94200493f7c1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:49.630806 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b3735601-45f0-41bc-96e8-94200493f7c1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:49.761460 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-b3735601-45f0-41bc-96e8-94200493f7c1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:49.769823 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-b3735601-45f0-41bc-96e8-94200493f7c1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:49.771312 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-b3735601-45f0-41bc-96e8-94200493f7c1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:49.772447 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-b3735601-45f0-41bc-96e8-94200493f7c1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1722 microversion: 2.20 time: 0.154599 Jul 12 14:45:49.773001 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 404/805] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:45:49 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:45:50.547556 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-329e5a7c-2f14-4462-8e76-f988dc52d37a tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:50.548161 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-329e5a7c-2f14-4462-8e76-f988dc52d37a tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:50.554617 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-329e5a7c-2f14-4462-8e76-f988dc52d37a tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:50.555057 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-329e5a7c-2f14-4462-8e76-f988dc52d37a tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:50.555805 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-329e5a7c-2f14-4462-8e76-f988dc52d37a tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:50.556234 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-329e5a7c-2f14-4462-8e76-f988dc52d37a tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:50.686882 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-329e5a7c-2f14-4462-8e76-f988dc52d37a tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:50.694612 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-329e5a7c-2f14-4462-8e76-f988dc52d37a tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1444 microversion: 2.1 time: 0.150819 Jul 12 14:45:50.696845 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 402/806] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:50 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:50.711452 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d72d55c7-fceb-4e14-a29d-c6c8a302bbae tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:50.712230 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-d72d55c7-fceb-4e14-a29d-c6c8a302bbae tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:50.720792 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d72d55c7-fceb-4e14-a29d-c6c8a302bbae tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:50.721283 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d72d55c7-fceb-4e14-a29d-c6c8a302bbae tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:50.722639 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d72d55c7-fceb-4e14-a29d-c6c8a302bbae tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:50.723078 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d72d55c7-fceb-4e14-a29d-c6c8a302bbae tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:50.791479 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-617a8d34-54f2-4b47-94c9-de8a4ec6f9f3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:50.792395 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-617a8d34-54f2-4b47-94c9-de8a4ec6f9f3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:50.798622 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-617a8d34-54f2-4b47-94c9-de8a4ec6f9f3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:50.799081 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-617a8d34-54f2-4b47-94c9-de8a4ec6f9f3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:50.800004 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-617a8d34-54f2-4b47-94c9-de8a4ec6f9f3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:50.800427 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-617a8d34-54f2-4b47-94c9-de8a4ec6f9f3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:50.891934 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d72d55c7-fceb-4e14-a29d-c6c8a302bbae tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:50.899055 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-d72d55c7-fceb-4e14-a29d-c6c8a302bbae tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1444 microversion: 2.1 time: 0.191532 Jul 12 14:45:50.899733 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 405/807] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:50 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1444 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:50.963094 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-617a8d34-54f2-4b47-94c9-de8a4ec6f9f3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:50.971411 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:50.971411 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-617a8d34-54f2-4b47-94c9-de8a4ec6f9f3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:50.972954 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-617a8d34-54f2-4b47-94c9-de8a4ec6f9f3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:50.974147 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-617a8d34-54f2-4b47-94c9-de8a4ec6f9f3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1722 microversion: 2.20 time: 0.186942 Jul 12 14:45:50.974731 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 403/808] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:45:50 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:45:51.992081 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-6837e94a-a8a1-46ea-bc7a-9a963eb8e8b9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:51.993306 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-6837e94a-a8a1-46ea-bc7a-9a963eb8e8b9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:52.000323 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6837e94a-a8a1-46ea-bc7a-9a963eb8e8b9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:52.001115 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6837e94a-a8a1-46ea-bc7a-9a963eb8e8b9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:52.001915 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6837e94a-a8a1-46ea-bc7a-9a963eb8e8b9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:52.002348 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6837e94a-a8a1-46ea-bc7a-9a963eb8e8b9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:52.224751 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-6837e94a-a8a1-46ea-bc7a-9a963eb8e8b9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:52.233881 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-6837e94a-a8a1-46ea-bc7a-9a963eb8e8b9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:52.235878 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-6837e94a-a8a1-46ea-bc7a-9a963eb8e8b9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:52.237060 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-6837e94a-a8a1-46ea-bc7a-9a963eb8e8b9 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1722 microversion: 2.20 time: 0.249196 Jul 12 14:45:52.238491 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 406/809] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:45:51 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:45:53.258210 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-8b868559-45cd-4fed-8ab0-fa110c99b5bb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:53.259476 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-8b868559-45cd-4fed-8ab0-fa110c99b5bb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:53.267422 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8b868559-45cd-4fed-8ab0-fa110c99b5bb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:53.268191 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8b868559-45cd-4fed-8ab0-fa110c99b5bb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:53.268972 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8b868559-45cd-4fed-8ab0-fa110c99b5bb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:53.269480 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8b868559-45cd-4fed-8ab0-fa110c99b5bb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:53.421195 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-8b868559-45cd-4fed-8ab0-fa110c99b5bb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:53.431604 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-8b868559-45cd-4fed-8ab0-fa110c99b5bb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:53.433620 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-8b868559-45cd-4fed-8ab0-fa110c99b5bb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:53.435064 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-8b868559-45cd-4fed-8ab0-fa110c99b5bb tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1722 microversion: 2.20 time: 0.181268 Jul 12 14:45:53.440739 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 404/810] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:45:53 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:45:53.541727 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-3bb11642-1ba1-4b0d-b047-43a3c075059e req-93fd98a5-ed15-4bc8-be2b-961f4376d7b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "336f3e15-d106-4a54-b655-49328b81248d", "tag": "07cdb948-262b-44e3-a60e-ac8f1916b818"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:45:53.550481 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-3bb11642-1ba1-4b0d-b047-43a3c075059e req-93fd98a5-ed15-4bc8-be2b-961f4376d7b3 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:53.550928 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-3bb11642-1ba1-4b0d-b047-43a3c075059e req-93fd98a5-ed15-4bc8-be2b-961f4376d7b3 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:53.569651 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-3bb11642-1ba1-4b0d-b047-43a3c075059e req-93fd98a5-ed15-4bc8-be2b-961f4376d7b3 service nova] Creating event network-changed:07cdb948-262b-44e3-a60e-ac8f1916b818 for instance 336f3e15-d106-4a54-b655-49328b81248d on hv-cinder-82002 Jul 12 14:45:53.574700 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-3bb11642-1ba1-4b0d-b047-43a3c075059e req-93fd98a5-ed15-4bc8-be2b-961f4376d7b3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036658 Jul 12 14:45:53.575441 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 407/811] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:45:54.457809 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0b68b023-7ab4-4692-8ca6-3a832c073362 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:54.458411 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-0b68b023-7ab4-4692-8ca6-3a832c073362 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:54.465122 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0b68b023-7ab4-4692-8ca6-3a832c073362 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:54.465603 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0b68b023-7ab4-4692-8ca6-3a832c073362 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:54.466373 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0b68b023-7ab4-4692-8ca6-3a832c073362 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:54.466815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0b68b023-7ab4-4692-8ca6-3a832c073362 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:54.630264 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-0b68b023-7ab4-4692-8ca6-3a832c073362 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:54.638471 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-0b68b023-7ab4-4692-8ca6-3a832c073362 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:54.639966 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-0b68b023-7ab4-4692-8ca6-3a832c073362 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:54.641259 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-0b68b023-7ab4-4692-8ca6-3a832c073362 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1722 microversion: 2.20 time: 0.188284 Jul 12 14:45:54.641815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 405/812] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:45:54 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:45:55.660269 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d689b59e-7aa9-440c-8ee3-bea2a3ad2d1c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:55.660995 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-d689b59e-7aa9-440c-8ee3-bea2a3ad2d1c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:55.667885 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d689b59e-7aa9-440c-8ee3-bea2a3ad2d1c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:55.668343 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d689b59e-7aa9-440c-8ee3-bea2a3ad2d1c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:55.669075 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d689b59e-7aa9-440c-8ee3-bea2a3ad2d1c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:55.669537 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d689b59e-7aa9-440c-8ee3-bea2a3ad2d1c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:55.804304 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d689b59e-7aa9-440c-8ee3-bea2a3ad2d1c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:55.812389 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d689b59e-7aa9-440c-8ee3-bea2a3ad2d1c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:55.814058 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d689b59e-7aa9-440c-8ee3-bea2a3ad2d1c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:55.815320 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-d689b59e-7aa9-440c-8ee3-bea2a3ad2d1c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1743 microversion: 2.20 time: 0.159346 Jul 12 14:45:55.816189 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 408/813] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:45:55 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:45:56.834115 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ae52a4ed-4199-4913-b6fc-8b4a10d9e08f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:56.834716 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-ae52a4ed-4199-4913-b6fc-8b4a10d9e08f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:56.837011 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:56.841771 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ae52a4ed-4199-4913-b6fc-8b4a10d9e08f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:56.842215 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ae52a4ed-4199-4913-b6fc-8b4a10d9e08f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:56.842973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ae52a4ed-4199-4913-b6fc-8b4a10d9e08f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:56.843406 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ae52a4ed-4199-4913-b6fc-8b4a10d9e08f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:56.976816 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ae52a4ed-4199-4913-b6fc-8b4a10d9e08f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:56.985192 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ae52a4ed-4199-4913-b6fc-8b4a10d9e08f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:56.986909 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ae52a4ed-4199-4913-b6fc-8b4a10d9e08f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:56.988733 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ae52a4ed-4199-4913-b6fc-8b4a10d9e08f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1743 microversion: 2.20 time: 0.157857 Jul 12 14:45:56.989309 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 406/814] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:45:56 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:45:57.926552 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-fefe1734-5d0f-49a8-a9bb-29fe7fb92928 req-d8306e72-a49c-4fb8-be25-f90b4aae3e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80951178-6d64-4856-a450-a1e1b64c2586", "name": "network-vif-plugged", "status": "completed", "tag": "46daa7fa-cab1-4811-a00f-fa4746971c05"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:45:57.936951 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-fefe1734-5d0f-49a8-a9bb-29fe7fb92928 req-d8306e72-a49c-4fb8-be25-f90b4aae3e87 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:57.937580 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-fefe1734-5d0f-49a8-a9bb-29fe7fb92928 req-d8306e72-a49c-4fb8-be25-f90b4aae3e87 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:57.949516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-fefe1734-5d0f-49a8-a9bb-29fe7fb92928 req-d8306e72-a49c-4fb8-be25-f90b4aae3e87 service nova] Creating event network-vif-plugged:46daa7fa-cab1-4811-a00f-fa4746971c05 for instance 80951178-6d64-4856-a450-a1e1b64c2586 on hv-cinder-82002 Jul 12 14:45:57.955401 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-fefe1734-5d0f-49a8-a9bb-29fe7fb92928 req-d8306e72-a49c-4fb8-be25-f90b4aae3e87 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032829 Jul 12 14:45:57.956216 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 409/815] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:45:58.008915 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-340a72e8-bfad-490d-85f3-c080df7495e4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:58.010669 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-340a72e8-bfad-490d-85f3-c080df7495e4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:58.018864 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-340a72e8-bfad-490d-85f3-c080df7495e4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:58.019985 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-340a72e8-bfad-490d-85f3-c080df7495e4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:58.020765 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-340a72e8-bfad-490d-85f3-c080df7495e4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:58.021237 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-340a72e8-bfad-490d-85f3-c080df7495e4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:58.182107 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-340a72e8-bfad-490d-85f3-c080df7495e4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:58.191148 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-340a72e8-bfad-490d-85f3-c080df7495e4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:58.193379 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-340a72e8-bfad-490d-85f3-c080df7495e4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:58.194716 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-340a72e8-bfad-490d-85f3-c080df7495e4 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1738 microversion: 2.20 time: 0.191336 Jul 12 14:45:58.195619 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 407/816] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:45:58 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:45:59.217126 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-64c483a9-a1d6-4d68-a931-e90972dcef9c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:59.218566 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-64c483a9-a1d6-4d68-a931-e90972dcef9c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:59.226045 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-64c483a9-a1d6-4d68-a931-e90972dcef9c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:59.226580 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-64c483a9-a1d6-4d68-a931-e90972dcef9c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:59.227702 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-64c483a9-a1d6-4d68-a931-e90972dcef9c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:59.229014 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-64c483a9-a1d6-4d68-a931-e90972dcef9c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:59.429873 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-64c483a9-a1d6-4d68-a931-e90972dcef9c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:59.438397 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-64c483a9-a1d6-4d68-a931-e90972dcef9c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:59.440177 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-64c483a9-a1d6-4d68-a931-e90972dcef9c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:59.441534 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-64c483a9-a1d6-4d68-a931-e90972dcef9c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1738 microversion: 2.20 time: 0.229320 Jul 12 14:45:59.461969 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 410/817] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:45:59 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1738 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:00.464286 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-acfa12ed-ea6e-40f0-aab5-97605ad8e4fe tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:00.464894 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-acfa12ed-ea6e-40f0-aab5-97605ad8e4fe tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:00.472725 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-acfa12ed-ea6e-40f0-aab5-97605ad8e4fe tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:00.473142 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-acfa12ed-ea6e-40f0-aab5-97605ad8e4fe tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:00.473945 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-acfa12ed-ea6e-40f0-aab5-97605ad8e4fe tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:00.474551 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-acfa12ed-ea6e-40f0-aab5-97605ad8e4fe tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:00.632173 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-acfa12ed-ea6e-40f0-aab5-97605ad8e4fe tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:00.640912 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-acfa12ed-ea6e-40f0-aab5-97605ad8e4fe tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:00.642491 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-acfa12ed-ea6e-40f0-aab5-97605ad8e4fe tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:00.643715 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-acfa12ed-ea6e-40f0-aab5-97605ad8e4fe tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1738 microversion: 2.20 time: 0.183733 Jul 12 14:46:00.644336 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 408/818] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:00 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:01.662711 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-f14b60ba-4e55-4ddf-b068-fc6cd201bb4e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:01.664088 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-f14b60ba-4e55-4ddf-b068-fc6cd201bb4e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:01.671523 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f14b60ba-4e55-4ddf-b068-fc6cd201bb4e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:01.672064 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f14b60ba-4e55-4ddf-b068-fc6cd201bb4e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:01.672939 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f14b60ba-4e55-4ddf-b068-fc6cd201bb4e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:01.673476 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f14b60ba-4e55-4ddf-b068-fc6cd201bb4e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:01.853344 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-f14b60ba-4e55-4ddf-b068-fc6cd201bb4e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:01.872027 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-f14b60ba-4e55-4ddf-b068-fc6cd201bb4e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:01.873646 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-f14b60ba-4e55-4ddf-b068-fc6cd201bb4e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:01.875304 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-f14b60ba-4e55-4ddf-b068-fc6cd201bb4e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1738 microversion: 2.20 time: 0.217068 Jul 12 14:46:01.888015 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 411/819] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:01 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1738 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:02.900970 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-bf0a33b4-99f3-4f82-9932-db065e20ba43 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:02.902979 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-bf0a33b4-99f3-4f82-9932-db065e20ba43 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:02.912078 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bf0a33b4-99f3-4f82-9932-db065e20ba43 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:02.914708 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bf0a33b4-99f3-4f82-9932-db065e20ba43 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:02.915740 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bf0a33b4-99f3-4f82-9932-db065e20ba43 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:02.916363 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bf0a33b4-99f3-4f82-9932-db065e20ba43 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:03.078424 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-bf0a33b4-99f3-4f82-9932-db065e20ba43 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:03.087066 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-bf0a33b4-99f3-4f82-9932-db065e20ba43 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:03.088573 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-bf0a33b4-99f3-4f82-9932-db065e20ba43 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:03.089848 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-bf0a33b4-99f3-4f82-9932-db065e20ba43 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1738 microversion: 2.20 time: 0.193801 Jul 12 14:46:03.090844 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 409/820] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:02 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:04.110342 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-216279a8-e5f6-45b7-8d21-e235c6a19748 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:04.111202 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-216279a8-e5f6-45b7-8d21-e235c6a19748 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:04.119013 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-216279a8-e5f6-45b7-8d21-e235c6a19748 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:04.119471 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-216279a8-e5f6-45b7-8d21-e235c6a19748 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:04.120261 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-216279a8-e5f6-45b7-8d21-e235c6a19748 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:04.120732 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-216279a8-e5f6-45b7-8d21-e235c6a19748 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:04.291076 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-216279a8-e5f6-45b7-8d21-e235c6a19748 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:04.299803 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-216279a8-e5f6-45b7-8d21-e235c6a19748 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:04.301880 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-216279a8-e5f6-45b7-8d21-e235c6a19748 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:04.303052 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-216279a8-e5f6-45b7-8d21-e235c6a19748 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1738 microversion: 2.20 time: 0.196983 Jul 12 14:46:04.303972 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 412/821] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:04 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:05.321877 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-3f33ec03-30f1-45f2-9f03-7a86fdb50d22 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:05.323394 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-3f33ec03-30f1-45f2-9f03-7a86fdb50d22 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:05.331699 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3f33ec03-30f1-45f2-9f03-7a86fdb50d22 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:05.334868 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3f33ec03-30f1-45f2-9f03-7a86fdb50d22 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:05.334868 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3f33ec03-30f1-45f2-9f03-7a86fdb50d22 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:05.334868 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3f33ec03-30f1-45f2-9f03-7a86fdb50d22 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:05.516354 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-3f33ec03-30f1-45f2-9f03-7a86fdb50d22 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:05.525125 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-3f33ec03-30f1-45f2-9f03-7a86fdb50d22 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:05.527186 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-3f33ec03-30f1-45f2-9f03-7a86fdb50d22 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:05.528339 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-3f33ec03-30f1-45f2-9f03-7a86fdb50d22 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1738 microversion: 2.20 time: 0.211149 Jul 12 14:46:05.529641 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 410/822] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:05 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:06.548168 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-ab3e0060-99e4-4888-8277-0621645a800b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:06.549421 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-ab3e0060-99e4-4888-8277-0621645a800b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:06.556395 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ab3e0060-99e4-4888-8277-0621645a800b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:06.557059 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ab3e0060-99e4-4888-8277-0621645a800b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:06.558035 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ab3e0060-99e4-4888-8277-0621645a800b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:06.558468 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ab3e0060-99e4-4888-8277-0621645a800b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:06.723568 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-ab3e0060-99e4-4888-8277-0621645a800b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:06.742061 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-ab3e0060-99e4-4888-8277-0621645a800b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:06.744300 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-ab3e0060-99e4-4888-8277-0621645a800b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:06.746261 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-ab3e0060-99e4-4888-8277-0621645a800b tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1738 microversion: 2.20 time: 0.202044 Jul 12 14:46:06.746816 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 413/823] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:06 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:07.390969 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-83cb81c1-6853-4c7b-89b5-d68c9814cc26 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:07.391618 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-83cb81c1-6853-4c7b-89b5-d68c9814cc26 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:07.399142 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-83cb81c1-6853-4c7b-89b5-d68c9814cc26 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:07.399595 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-83cb81c1-6853-4c7b-89b5-d68c9814cc26 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:07.400379 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-83cb81c1-6853-4c7b-89b5-d68c9814cc26 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:07.400819 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-83cb81c1-6853-4c7b-89b5-d68c9814cc26 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:07.429128 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-83cb81c1-6853-4c7b-89b5-d68c9814cc26 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15/ips" status: 200 len: 147 microversion: 2.1 time: 0.041975 Jul 12 14:46:07.429868 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 411/824] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Jul 12 14:46:07 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15/ips => generated 147 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:46:07.765456 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-4621916c-1513-4cac-8a3c-af158565f077 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:07.766081 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-4621916c-1513-4cac-8a3c-af158565f077 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:07.774797 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4621916c-1513-4cac-8a3c-af158565f077 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:07.775367 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4621916c-1513-4cac-8a3c-af158565f077 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:07.776210 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4621916c-1513-4cac-8a3c-af158565f077 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:07.776731 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4621916c-1513-4cac-8a3c-af158565f077 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:07.913668 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-4621916c-1513-4cac-8a3c-af158565f077 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:07.921854 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-4621916c-1513-4cac-8a3c-af158565f077 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:07.923351 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-4621916c-1513-4cac-8a3c-af158565f077 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:07.924519 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-4621916c-1513-4cac-8a3c-af158565f077 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1738 microversion: 2.20 time: 0.163137 Jul 12 14:46:07.925309 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 414/825] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:07 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:08.943304 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-dea48a62-7014-4925-91ac-d5138cbd581c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:08.943932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-dea48a62-7014-4925-91ac-d5138cbd581c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:08.950394 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-dea48a62-7014-4925-91ac-d5138cbd581c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:08.950838 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-dea48a62-7014-4925-91ac-d5138cbd581c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:08.951594 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-dea48a62-7014-4925-91ac-d5138cbd581c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:08.952033 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-dea48a62-7014-4925-91ac-d5138cbd581c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:09.088797 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-dea48a62-7014-4925-91ac-d5138cbd581c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:09.096726 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-dea48a62-7014-4925-91ac-d5138cbd581c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:09.098226 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-dea48a62-7014-4925-91ac-d5138cbd581c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:09.099382 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-dea48a62-7014-4925-91ac-d5138cbd581c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1738 microversion: 2.20 time: 0.160511 Jul 12 14:46:09.099939 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 412/826] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:08 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:09.468099 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-820bd386-8494-4072-8e2a-5f01c6d0085f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5d65b4b-47f6-4084-b940-35be76342e60"}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:46:09.469178 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-820bd386-8494-4072-8e2a-5f01c6d0085f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:09.471622 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_api:SELECT=48 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:09.476373 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-820bd386-8494-4072-8e2a-5f01c6d0085f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:09.476821 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-820bd386-8494-4072-8e2a-5f01c6d0085f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:09.477612 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-820bd386-8494-4072-8e2a-5f01c6d0085f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:09.478047 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-820bd386-8494-4072-8e2a-5f01c6d0085f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:10.122119 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ba2ee1bf-a5b2-4643-9bb0-2bc567ca6207 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:10.122824 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-ba2ee1bf-a5b2-4643-9bb0-2bc567ca6207 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:10.130399 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ba2ee1bf-a5b2-4643-9bb0-2bc567ca6207 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:10.130852 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ba2ee1bf-a5b2-4643-9bb0-2bc567ca6207 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:10.131615 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ba2ee1bf-a5b2-4643-9bb0-2bc567ca6207 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:10.132052 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ba2ee1bf-a5b2-4643-9bb0-2bc567ca6207 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:10.340813 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ba2ee1bf-a5b2-4643-9bb0-2bc567ca6207 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:10.349048 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ba2ee1bf-a5b2-4643-9bb0-2bc567ca6207 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:10.350566 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ba2ee1bf-a5b2-4643-9bb0-2bc567ca6207 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:10.351725 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ba2ee1bf-a5b2-4643-9bb0-2bc567ca6207 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1720 microversion: 2.20 time: 0.233713 Jul 12 14:46:10.356031 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 413/827] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:10 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1720 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:10.397854 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:10.494527 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-820bd386-8494-4072-8e2a-5f01c6d0085f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "POST /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.030058 Jul 12 14:46:10.500673 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 415/828] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Jul 12 14:46:09 2022] POST /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15/os-volume_attachments => generated 194 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:46:11.370301 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-3a7e556d-4440-46c3-9be2-92357e239621 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:11.370972 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-3a7e556d-4440-46c3-9be2-92357e239621 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:11.377666 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3a7e556d-4440-46c3-9be2-92357e239621 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:11.378105 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3a7e556d-4440-46c3-9be2-92357e239621 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:11.378862 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3a7e556d-4440-46c3-9be2-92357e239621 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:11.379292 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-3a7e556d-4440-46c3-9be2-92357e239621 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:11.508139 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-3a7e556d-4440-46c3-9be2-92357e239621 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:11.516104 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-3a7e556d-4440-46c3-9be2-92357e239621 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:11.517637 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-3a7e556d-4440-46c3-9be2-92357e239621 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:11.518784 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-3a7e556d-4440-46c3-9be2-92357e239621 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1720 microversion: 2.20 time: 0.152373 Jul 12 14:46:11.520026 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 414/829] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:11 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:12.538683 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-400a2289-ee49-4142-8257-0d68578796a7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:12.539383 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-400a2289-ee49-4142-8257-0d68578796a7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:12.546435 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-400a2289-ee49-4142-8257-0d68578796a7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:12.546887 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-400a2289-ee49-4142-8257-0d68578796a7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:12.547652 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-400a2289-ee49-4142-8257-0d68578796a7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:12.548089 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-400a2289-ee49-4142-8257-0d68578796a7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:12.694336 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-400a2289-ee49-4142-8257-0d68578796a7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:12.702385 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-400a2289-ee49-4142-8257-0d68578796a7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:12.703919 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-400a2289-ee49-4142-8257-0d68578796a7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:12.705059 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-400a2289-ee49-4142-8257-0d68578796a7 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1720 microversion: 2.20 time: 0.171197 Jul 12 14:46:12.705734 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 416/830] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:12 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:13.723744 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-d4117975-e60e-40c3-9746-1bb0b7c4b3ea tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:13.724368 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-d4117975-e60e-40c3-9746-1bb0b7c4b3ea tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:13.730691 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d4117975-e60e-40c3-9746-1bb0b7c4b3ea tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:13.731141 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d4117975-e60e-40c3-9746-1bb0b7c4b3ea tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:13.731921 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d4117975-e60e-40c3-9746-1bb0b7c4b3ea tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:13.732351 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d4117975-e60e-40c3-9746-1bb0b7c4b3ea tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:13.878523 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-d4117975-e60e-40c3-9746-1bb0b7c4b3ea tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:13.887203 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-d4117975-e60e-40c3-9746-1bb0b7c4b3ea tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:13.888727 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-d4117975-e60e-40c3-9746-1bb0b7c4b3ea tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:13.889923 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-d4117975-e60e-40c3-9746-1bb0b7c4b3ea tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1723 microversion: 2.20 time: 0.170618 Jul 12 14:46:13.890494 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 415/831] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:13 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:13.908149 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-f41afd35-043c-4cd5-bd2b-6a2c3303a339 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b10e9206-ab40-477b-906c-4b51361b50cf"}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:46:13.909293 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-f41afd35-043c-4cd5-bd2b-6a2c3303a339 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:13.916538 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f41afd35-043c-4cd5-bd2b-6a2c3303a339 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:13.916997 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f41afd35-043c-4cd5-bd2b-6a2c3303a339 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:13.917860 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f41afd35-043c-4cd5-bd2b-6a2c3303a339 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:13.918293 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f41afd35-043c-4cd5-bd2b-6a2c3303a339 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:13.967965 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-1e1e8006-e9b9-4c91-8846-318cad754b17 req-9149fd7a-1ed0-4374-bffe-4d8bde768af4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80951178-6d64-4856-a450-a1e1b64c2586", "name": "network-vif-unplugged", "status": "completed", "tag": "46daa7fa-cab1-4811-a00f-fa4746971c05"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:46:13.977573 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-1e1e8006-e9b9-4c91-8846-318cad754b17 req-9149fd7a-1ed0-4374-bffe-4d8bde768af4 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:13.978485 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-1e1e8006-e9b9-4c91-8846-318cad754b17 req-9149fd7a-1ed0-4374-bffe-4d8bde768af4 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:13.990759 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-1e1e8006-e9b9-4c91-8846-318cad754b17 req-9149fd7a-1ed0-4374-bffe-4d8bde768af4 service nova] Creating event network-vif-unplugged:46daa7fa-cab1-4811-a00f-fa4746971c05 for instance 80951178-6d64-4856-a450-a1e1b64c2586 on hv-cinder-82002 Jul 12 14:46:13.995988 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-1e1e8006-e9b9-4c91-8846-318cad754b17 req-9149fd7a-1ed0-4374-bffe-4d8bde768af4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032292 Jul 12 14:46:13.996785 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 416/832] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:46:15.018747 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-f41afd35-043c-4cd5-bd2b-6a2c3303a339 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "POST /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.114314 Jul 12 14:46:15.019458 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 417/833] 10.222.0.30 () {62 vars in 1363 bytes} [Tue Jul 12 14:46:13 2022] POST /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586/os-volume_attachments => generated 188 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 14:46:15.136083 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ab3e875c-d667-46dc-954d-4937d75b6b5f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:15.136666 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-ab3e875c-d667-46dc-954d-4937d75b6b5f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:15.142832 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ab3e875c-d667-46dc-954d-4937d75b6b5f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:15.143285 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ab3e875c-d667-46dc-954d-4937d75b6b5f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:15.144046 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ab3e875c-d667-46dc-954d-4937d75b6b5f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:15.145110 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ab3e875c-d667-46dc-954d-4937d75b6b5f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:15.734254 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ab3e875c-d667-46dc-954d-4937d75b6b5f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "DELETE /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586/os-volume_attachments/b10e9206-ab40-477b-906c-4b51361b50cf" status: 202 len: 0 microversion: 2.20 time: 0.602822 Jul 12 14:46:15.734848 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 417/834] 10.222.0.30 () {60 vars in 1456 bytes} [Tue Jul 12 14:46:15 2022] DELETE /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586/os-volume_attachments/b10e9206-ab40-477b-906c-4b51361b50cf => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:46:15.794930 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d054fe05-1ee9-4f2d-9618-152ca5f54ace tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:46:15.795588 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-d054fe05-1ee9-4f2d-9618-152ca5f54ace tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:15.803106 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d054fe05-1ee9-4f2d-9618-152ca5f54ace tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:15.803632 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d054fe05-1ee9-4f2d-9618-152ca5f54ace tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:15.804403 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d054fe05-1ee9-4f2d-9618-152ca5f54ace tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:15.804838 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d054fe05-1ee9-4f2d-9618-152ca5f54ace tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:16.016783 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-d054fe05-1ee9-4f2d-9618-152ca5f54ace tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "POST /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586/action" status: 202 len: 0 microversion: 2.20 time: 0.225715 Jul 12 14:46:16.017341 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 418/835] 10.222.0.30 () {62 vars in 1318 bytes} [Tue Jul 12 14:46:15 2022] POST /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:46:16.025893 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ac392bc0-047c-4478-bdd8-d9574f57f4ba tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:16.026585 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-ac392bc0-047c-4478-bdd8-d9574f57f4ba tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:16.032651 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ac392bc0-047c-4478-bdd8-d9574f57f4ba tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:16.033145 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ac392bc0-047c-4478-bdd8-d9574f57f4ba tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:16.034044 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ac392bc0-047c-4478-bdd8-d9574f57f4ba tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:16.034482 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ac392bc0-047c-4478-bdd8-d9574f57f4ba tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:16.169222 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ac392bc0-047c-4478-bdd8-d9574f57f4ba tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:16.177417 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ac392bc0-047c-4478-bdd8-d9574f57f4ba tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:16.179198 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ac392bc0-047c-4478-bdd8-d9574f57f4ba tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:16.180263 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ac392bc0-047c-4478-bdd8-d9574f57f4ba tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1671 microversion: 2.20 time: 0.158236 Jul 12 14:46:16.180817 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 418/836] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:16 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:17.200546 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-2e8e1f32-ebc8-4f49-a45c-a01280e67b02 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:17.201398 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-2e8e1f32-ebc8-4f49-a45c-a01280e67b02 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:17.207661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2e8e1f32-ebc8-4f49-a45c-a01280e67b02 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:17.208055 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2e8e1f32-ebc8-4f49-a45c-a01280e67b02 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:17.208824 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2e8e1f32-ebc8-4f49-a45c-a01280e67b02 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:17.209300 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2e8e1f32-ebc8-4f49-a45c-a01280e67b02 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:17.344132 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-2e8e1f32-ebc8-4f49-a45c-a01280e67b02 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:17.353183 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-2e8e1f32-ebc8-4f49-a45c-a01280e67b02 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:17.354894 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-2e8e1f32-ebc8-4f49-a45c-a01280e67b02 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:17.356177 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-2e8e1f32-ebc8-4f49-a45c-a01280e67b02 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1673 microversion: 2.20 time: 0.160135 Jul 12 14:46:17.356822 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 419/837] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:17 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:18.375730 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0bffc6ed-b7fa-4eb1-b4d3-2d08cb5d6255 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:18.376660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-0bffc6ed-b7fa-4eb1-b4d3-2d08cb5d6255 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:18.383876 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0bffc6ed-b7fa-4eb1-b4d3-2d08cb5d6255 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:18.384331 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0bffc6ed-b7fa-4eb1-b4d3-2d08cb5d6255 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:18.385120 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0bffc6ed-b7fa-4eb1-b4d3-2d08cb5d6255 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:18.385766 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0bffc6ed-b7fa-4eb1-b4d3-2d08cb5d6255 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:18.402097 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:18.555091 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-0bffc6ed-b7fa-4eb1-b4d3-2d08cb5d6255 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:18.563156 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-0bffc6ed-b7fa-4eb1-b4d3-2d08cb5d6255 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:18.564662 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-0bffc6ed-b7fa-4eb1-b4d3-2d08cb5d6255 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:18.565841 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-0bffc6ed-b7fa-4eb1-b4d3-2d08cb5d6255 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1729 microversion: 2.20 time: 0.194168 Jul 12 14:46:18.567096 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 419/838] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:18 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:19.585325 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c163d8d7-a9bd-49d1-8564-e383dd9fc210 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:19.585932 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-c163d8d7-a9bd-49d1-8564-e383dd9fc210 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:19.596907 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c163d8d7-a9bd-49d1-8564-e383dd9fc210 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:19.597393 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c163d8d7-a9bd-49d1-8564-e383dd9fc210 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:19.598160 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c163d8d7-a9bd-49d1-8564-e383dd9fc210 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:19.598595 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c163d8d7-a9bd-49d1-8564-e383dd9fc210 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:19.752247 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c163d8d7-a9bd-49d1-8564-e383dd9fc210 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:19.760337 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c163d8d7-a9bd-49d1-8564-e383dd9fc210 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:19.761854 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c163d8d7-a9bd-49d1-8564-e383dd9fc210 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:19.763003 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-c163d8d7-a9bd-49d1-8564-e383dd9fc210 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1729 microversion: 2.20 time: 0.182353 Jul 12 14:46:19.763557 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 420/839] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:19 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:20.781662 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-d72849b4-2668-4a05-bd53-0d88a9634c0d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:20.782439 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-d72849b4-2668-4a05-bd53-0d88a9634c0d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:20.789619 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d72849b4-2668-4a05-bd53-0d88a9634c0d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:20.790073 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d72849b4-2668-4a05-bd53-0d88a9634c0d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:20.790843 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d72849b4-2668-4a05-bd53-0d88a9634c0d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:20.791321 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d72849b4-2668-4a05-bd53-0d88a9634c0d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:20.936297 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-d72849b4-2668-4a05-bd53-0d88a9634c0d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:20.945648 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-d72849b4-2668-4a05-bd53-0d88a9634c0d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:20.947142 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-d72849b4-2668-4a05-bd53-0d88a9634c0d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:20.957057 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-d72849b4-2668-4a05-bd53-0d88a9634c0d tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1729 microversion: 2.20 time: 0.170614 Jul 12 14:46:20.957057 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 420/840] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:20 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:21.966035 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c38bfd40-7027-4217-ada2-da804b94396c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:21.966717 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-c38bfd40-7027-4217-ada2-da804b94396c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:21.975704 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c38bfd40-7027-4217-ada2-da804b94396c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:21.976154 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c38bfd40-7027-4217-ada2-da804b94396c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:21.976928 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c38bfd40-7027-4217-ada2-da804b94396c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:21.977379 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c38bfd40-7027-4217-ada2-da804b94396c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:22.124141 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c38bfd40-7027-4217-ada2-da804b94396c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:22.147049 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c38bfd40-7027-4217-ada2-da804b94396c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:22.148755 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c38bfd40-7027-4217-ada2-da804b94396c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:22.149962 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-c38bfd40-7027-4217-ada2-da804b94396c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1729 microversion: 2.20 time: 0.187884 Jul 12 14:46:22.150808 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 421/841] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:21 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:23.169740 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-19059f2d-bdae-4e26-9546-553727fc8d46 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:23.170353 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-19059f2d-bdae-4e26-9546-553727fc8d46 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:23.178183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-19059f2d-bdae-4e26-9546-553727fc8d46 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:23.178634 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-19059f2d-bdae-4e26-9546-553727fc8d46 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:23.179403 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-19059f2d-bdae-4e26-9546-553727fc8d46 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:23.179844 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-19059f2d-bdae-4e26-9546-553727fc8d46 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:23.339188 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-19059f2d-bdae-4e26-9546-553727fc8d46 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:23.347923 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-19059f2d-bdae-4e26-9546-553727fc8d46 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:23.349499 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-19059f2d-bdae-4e26-9546-553727fc8d46 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:23.350742 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-19059f2d-bdae-4e26-9546-553727fc8d46 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1729 microversion: 2.20 time: 0.184966 Jul 12 14:46:23.355928 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 421/842] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:23 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:24.369535 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-8b42dc00-b643-40e9-b205-50c1eda9959c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:24.370146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-8b42dc00-b643-40e9-b205-50c1eda9959c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:24.377174 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8b42dc00-b643-40e9-b205-50c1eda9959c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:24.377647 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8b42dc00-b643-40e9-b205-50c1eda9959c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:24.378472 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8b42dc00-b643-40e9-b205-50c1eda9959c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:24.378914 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8b42dc00-b643-40e9-b205-50c1eda9959c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:24.513904 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-8b42dc00-b643-40e9-b205-50c1eda9959c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:24.522778 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-8b42dc00-b643-40e9-b205-50c1eda9959c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:24.524296 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-8b42dc00-b643-40e9-b205-50c1eda9959c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:24.525493 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-8b42dc00-b643-40e9-b205-50c1eda9959c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1729 microversion: 2.20 time: 0.159769 Jul 12 14:46:24.526066 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 422/843] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:24 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:25.545019 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-38e69c7b-b754-4b76-9f04-9e680db1b303 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:25.545766 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-38e69c7b-b754-4b76-9f04-9e680db1b303 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:25.553345 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-38e69c7b-b754-4b76-9f04-9e680db1b303 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:25.553894 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-38e69c7b-b754-4b76-9f04-9e680db1b303 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:25.554748 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-38e69c7b-b754-4b76-9f04-9e680db1b303 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:25.555281 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-38e69c7b-b754-4b76-9f04-9e680db1b303 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:25.703675 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-38e69c7b-b754-4b76-9f04-9e680db1b303 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:25.712480 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-38e69c7b-b754-4b76-9f04-9e680db1b303 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:25.714216 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-38e69c7b-b754-4b76-9f04-9e680db1b303 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:25.715664 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-38e69c7b-b754-4b76-9f04-9e680db1b303 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1729 microversion: 2.20 time: 0.174413 Jul 12 14:46:25.716406 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 422/844] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:25 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:26.734670 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-6ab6c0e8-2429-4dd2-b2ee-9b6385147212 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:26.735297 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-6ab6c0e8-2429-4dd2-b2ee-9b6385147212 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:26.742367 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6ab6c0e8-2429-4dd2-b2ee-9b6385147212 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:26.743146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6ab6c0e8-2429-4dd2-b2ee-9b6385147212 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:26.744162 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6ab6c0e8-2429-4dd2-b2ee-9b6385147212 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:26.744658 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6ab6c0e8-2429-4dd2-b2ee-9b6385147212 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:26.936747 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-6ab6c0e8-2429-4dd2-b2ee-9b6385147212 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:26.948289 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-6ab6c0e8-2429-4dd2-b2ee-9b6385147212 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:26.951636 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-6ab6c0e8-2429-4dd2-b2ee-9b6385147212 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:26.951636 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-6ab6c0e8-2429-4dd2-b2ee-9b6385147212 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1729 microversion: 2.20 time: 0.220615 Jul 12 14:46:26.972788 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 423/845] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:26 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1729 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:27.978878 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-87ea029a-8c36-458d-9a83-6b1143c0d14f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:27.980198 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-87ea029a-8c36-458d-9a83-6b1143c0d14f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:27.990610 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-87ea029a-8c36-458d-9a83-6b1143c0d14f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:27.991066 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-87ea029a-8c36-458d-9a83-6b1143c0d14f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:27.991848 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-87ea029a-8c36-458d-9a83-6b1143c0d14f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:27.997462 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-87ea029a-8c36-458d-9a83-6b1143c0d14f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:28.167946 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-87ea029a-8c36-458d-9a83-6b1143c0d14f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:28.180029 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-87ea029a-8c36-458d-9a83-6b1143c0d14f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:28.182400 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-87ea029a-8c36-458d-9a83-6b1143c0d14f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:28.183598 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-87ea029a-8c36-458d-9a83-6b1143c0d14f tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1729 microversion: 2.20 time: 0.212072 Jul 12 14:46:28.184485 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 423/846] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:27 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1729 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:29.204467 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-7229f480-eed2-4b83-883c-c4111511cdc1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:29.205061 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-7229f480-eed2-4b83-883c-c4111511cdc1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:29.211698 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7229f480-eed2-4b83-883c-c4111511cdc1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:29.212143 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7229f480-eed2-4b83-883c-c4111511cdc1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:29.212889 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7229f480-eed2-4b83-883c-c4111511cdc1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:29.213523 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7229f480-eed2-4b83-883c-c4111511cdc1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:29.346144 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7229f480-eed2-4b83-883c-c4111511cdc1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:29.352594 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7229f480-eed2-4b83-883c-c4111511cdc1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:29.354099 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7229f480-eed2-4b83-883c-c4111511cdc1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:29.355225 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-7229f480-eed2-4b83-883c-c4111511cdc1 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1729 microversion: 2.20 time: 0.154725 Jul 12 14:46:29.355775 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 424/847] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:29 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:30.373973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-5e3e7c05-3d6c-4ab6-9c48-3158b60b6a68 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:30.374569 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-5e3e7c05-3d6c-4ab6-9c48-3158b60b6a68 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:30.377104 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_api:SELECT=36 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:30.382482 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5e3e7c05-3d6c-4ab6-9c48-3158b60b6a68 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:30.382925 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5e3e7c05-3d6c-4ab6-9c48-3158b60b6a68 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:30.383675 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5e3e7c05-3d6c-4ab6-9c48-3158b60b6a68 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:30.384105 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5e3e7c05-3d6c-4ab6-9c48-3158b60b6a68 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:30.520840 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-5e3e7c05-3d6c-4ab6-9c48-3158b60b6a68 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:30.528876 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-5e3e7c05-3d6c-4ab6-9c48-3158b60b6a68 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:30.530358 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-5e3e7c05-3d6c-4ab6-9c48-3158b60b6a68 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:30.531502 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-5e3e7c05-3d6c-4ab6-9c48-3158b60b6a68 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1729 microversion: 2.20 time: 0.161500 Jul 12 14:46:30.532049 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 424/848] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:30 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:46:31.550337 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c1a924c9-48fb-4876-9561-0d3bfc609800 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:31.550994 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-c1a924c9-48fb-4876-9561-0d3bfc609800 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:31.557436 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c1a924c9-48fb-4876-9561-0d3bfc609800 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:31.560332 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c1a924c9-48fb-4876-9561-0d3bfc609800 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:31.560332 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c1a924c9-48fb-4876-9561-0d3bfc609800 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:31.560332 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c1a924c9-48fb-4876-9561-0d3bfc609800 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:31.761293 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c1a924c9-48fb-4876-9561-0d3bfc609800 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:31.771240 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c1a924c9-48fb-4876-9561-0d3bfc609800 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:31.773151 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c1a924c9-48fb-4876-9561-0d3bfc609800 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:31.774413 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-c1a924c9-48fb-4876-9561-0d3bfc609800 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1729 microversion: 2.20 time: 0.229135 Jul 12 14:46:31.782540 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 425/849] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:31 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1729 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:31.804536 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-e902fa3b-898b-484e-b1a0-4105a7b1c035 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:31.805549 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-e902fa3b-898b-484e-b1a0-4105a7b1c035 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:31.812514 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e902fa3b-898b-484e-b1a0-4105a7b1c035 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:31.813236 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e902fa3b-898b-484e-b1a0-4105a7b1c035 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:31.813760 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e902fa3b-898b-484e-b1a0-4105a7b1c035 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:31.814609 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e902fa3b-898b-484e-b1a0-4105a7b1c035 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:31.846061 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-e902fa3b-898b-484e-b1a0-4105a7b1c035 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046127 Jul 12 14:46:31.846769 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 425/850] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Jul 12 14:46:31 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:46:31.856782 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-1c99ac91-1451-4e82-8f7d-0fcfc7411804 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:31.857320 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-1c99ac91-1451-4e82-8f7d-0fcfc7411804 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:31.864123 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1c99ac91-1451-4e82-8f7d-0fcfc7411804 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:31.864549 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1c99ac91-1451-4e82-8f7d-0fcfc7411804 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:31.865390 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1c99ac91-1451-4e82-8f7d-0fcfc7411804 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:31.865826 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1c99ac91-1451-4e82-8f7d-0fcfc7411804 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:31.897100 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-1c99ac91-1451-4e82-8f7d-0fcfc7411804 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15/os-volume_attachments/b5d65b4b-47f6-4084-b940-35be76342e60" status: 200 len: 194 microversion: 2.1 time: 0.044233 Jul 12 14:46:31.898174 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 426/851] 10.222.0.30 () {58 vars in 1412 bytes} [Tue Jul 12 14:46:31 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15/os-volume_attachments/b5d65b4b-47f6-4084-b940-35be76342e60 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:46:32.013125 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-755613f6-72ed-4f34-afb4-fbade926355b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:32.013125 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-755613f6-72ed-4f34-afb4-fbade926355b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:32.028734 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-755613f6-72ed-4f34-afb4-fbade926355b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:32.029298 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-755613f6-72ed-4f34-afb4-fbade926355b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:32.030336 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-755613f6-72ed-4f34-afb4-fbade926355b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:32.030989 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-755613f6-72ed-4f34-afb4-fbade926355b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:32.059802 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-755613f6-72ed-4f34-afb4-fbade926355b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Going to try to terminate instance {{(pid=129980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:46:32.392491 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-755613f6-72ed-4f34-afb4-fbade926355b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "DELETE /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 204 len: 0 microversion: 2.1 time: 0.384496 Jul 12 14:46:32.395565 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 426/852] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Jul 12 14:46:32 2022] DELETE /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:46:32.402169 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-42152f25-9850-4def-84b3-31b6c1791df9 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:32.403039 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-42152f25-9850-4def-84b3-31b6c1791df9 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:32.409001 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-42152f25-9850-4def-84b3-31b6c1791df9 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:32.409485 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-42152f25-9850-4def-84b3-31b6c1791df9 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:32.410779 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-42152f25-9850-4def-84b3-31b6c1791df9 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:32.411370 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-42152f25-9850-4def-84b3-31b6c1791df9 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:32.554807 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-42152f25-9850-4def-84b3-31b6c1791df9 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:32.562674 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-42152f25-9850-4def-84b3-31b6c1791df9 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1577 microversion: 2.1 time: 0.165286 Jul 12 14:46:32.563232 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 427/853] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:32 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:32.793074 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ac826c91-a955-4ddb-a1c9-e1417d11e1b3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:32.793821 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-ac826c91-a955-4ddb-a1c9-e1417d11e1b3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:32.799976 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ac826c91-a955-4ddb-a1c9-e1417d11e1b3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:32.800719 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ac826c91-a955-4ddb-a1c9-e1417d11e1b3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:32.801523 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ac826c91-a955-4ddb-a1c9-e1417d11e1b3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:32.801957 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ac826c91-a955-4ddb-a1c9-e1417d11e1b3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:32.933428 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ac826c91-a955-4ddb-a1c9-e1417d11e1b3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:32.941328 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ac826c91-a955-4ddb-a1c9-e1417d11e1b3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:32.943344 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ac826c91-a955-4ddb-a1c9-e1417d11e1b3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:32.944493 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ac826c91-a955-4ddb-a1c9-e1417d11e1b3 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1729 microversion: 2.20 time: 0.155772 Jul 12 14:46:32.945049 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 427/854] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:32 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:33.588663 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-845d131d-2404-4fe0-9361-5e847dc330dd tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:33.589294 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-845d131d-2404-4fe0-9361-5e847dc330dd tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:33.592270 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-4f802b79-769b-4cc7-be85-6c7841614a7b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e77af7bd-d00c-4481-ad05-ca7cf1bfc272"}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:46:33.593375 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-4f802b79-769b-4cc7-be85-6c7841614a7b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:33.596007 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-845d131d-2404-4fe0-9361-5e847dc330dd tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:33.596462 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-845d131d-2404-4fe0-9361-5e847dc330dd tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:33.597261 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-845d131d-2404-4fe0-9361-5e847dc330dd tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:33.597696 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-845d131d-2404-4fe0-9361-5e847dc330dd tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:33.601404 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4f802b79-769b-4cc7-be85-6c7841614a7b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:33.601865 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4f802b79-769b-4cc7-be85-6c7841614a7b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:33.602687 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4f802b79-769b-4cc7-be85-6c7841614a7b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:33.603130 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4f802b79-769b-4cc7-be85-6c7841614a7b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:33.738098 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-845d131d-2404-4fe0-9361-5e847dc330dd tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:33.741591 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:33.745943 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-845d131d-2404-4fe0-9361-5e847dc330dd tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1577 microversion: 2.1 time: 0.161100 Jul 12 14:46:33.762048 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 428/855] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:33 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:33.965010 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-51dde0f3-879b-4bda-bb18-ad416cdd3285 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:33.969012 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-51dde0f3-879b-4bda-bb18-ad416cdd3285 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:33.972752 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-51dde0f3-879b-4bda-bb18-ad416cdd3285 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:33.973498 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-51dde0f3-879b-4bda-bb18-ad416cdd3285 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:33.974454 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-51dde0f3-879b-4bda-bb18-ad416cdd3285 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:33.974888 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-51dde0f3-879b-4bda-bb18-ad416cdd3285 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:34.114770 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-51dde0f3-879b-4bda-bb18-ad416cdd3285 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:34.122990 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-51dde0f3-879b-4bda-bb18-ad416cdd3285 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:34.124551 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-51dde0f3-879b-4bda-bb18-ad416cdd3285 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:34.125643 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-51dde0f3-879b-4bda-bb18-ad416cdd3285 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1729 microversion: 2.20 time: 0.166352 Jul 12 14:46:34.126203 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 429/856] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:33 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:34.138829 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-7e1ddc52-a1ce-4a83-b09b-58027c4747b9 req-0b15f678-b4a4-4e20-844c-01c1bcedc1b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80951178-6d64-4856-a450-a1e1b64c2586", "name": "network-vif-plugged", "status": "completed", "tag": "46daa7fa-cab1-4811-a00f-fa4746971c05"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:46:34.147324 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-7e1ddc52-a1ce-4a83-b09b-58027c4747b9 req-0b15f678-b4a4-4e20-844c-01c1bcedc1b8 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:34.147889 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-7e1ddc52-a1ce-4a83-b09b-58027c4747b9 req-0b15f678-b4a4-4e20-844c-01c1bcedc1b8 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:34.159909 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-7e1ddc52-a1ce-4a83-b09b-58027c4747b9 req-0b15f678-b4a4-4e20-844c-01c1bcedc1b8 service nova] Creating event network-vif-plugged:46daa7fa-cab1-4811-a00f-fa4746971c05 for instance 80951178-6d64-4856-a450-a1e1b64c2586 on hv-cinder-82002 Jul 12 14:46:34.164961 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-7e1ddc52-a1ce-4a83-b09b-58027c4747b9 req-0b15f678-b4a4-4e20-844c-01c1bcedc1b8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037052 Jul 12 14:46:34.165579 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 430/857] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:46:34.728063 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-4f802b79-769b-4cc7-be85-6c7841614a7b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "POST /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.139486 Jul 12 14:46:34.728971 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 428/858] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Jul 12 14:46:33 2022] POST /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15/os-volume_attachments => generated 194 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:46:34.765716 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-28ccac89-18af-4433-92a6-7a2cb5db13e0 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:34.766716 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-28ccac89-18af-4433-92a6-7a2cb5db13e0 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:34.775168 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-28ccac89-18af-4433-92a6-7a2cb5db13e0 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:34.775982 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-28ccac89-18af-4433-92a6-7a2cb5db13e0 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:34.777750 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-28ccac89-18af-4433-92a6-7a2cb5db13e0 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:34.782010 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-28ccac89-18af-4433-92a6-7a2cb5db13e0 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:35.023812 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-28ccac89-18af-4433-92a6-7a2cb5db13e0 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:35.031279 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-28ccac89-18af-4433-92a6-7a2cb5db13e0 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1577 microversion: 2.1 time: 0.270851 Jul 12 14:46:35.031845 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 431/859] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:34 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1577 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:35.145540 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-db3bd566-85b4-40da-a42a-9497296dd376 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:35.146367 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-db3bd566-85b4-40da-a42a-9497296dd376 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:35.153015 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-db3bd566-85b4-40da-a42a-9497296dd376 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:35.153803 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-db3bd566-85b4-40da-a42a-9497296dd376 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:35.154706 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-db3bd566-85b4-40da-a42a-9497296dd376 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:35.155147 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-db3bd566-85b4-40da-a42a-9497296dd376 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:35.340898 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-db3bd566-85b4-40da-a42a-9497296dd376 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:35.349489 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-db3bd566-85b4-40da-a42a-9497296dd376 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:35.350993 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-db3bd566-85b4-40da-a42a-9497296dd376 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:35.352139 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-db3bd566-85b4-40da-a42a-9497296dd376 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1729 microversion: 2.20 time: 0.210938 Jul 12 14:46:35.352868 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 429/860] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:35 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1729 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:35.706342 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-d10fc6ad-e2ce-4f36-ae77-a47ac4b72003 req-fecfadf0-6e62-463c-bc86-ec0a5bc36018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01cf8542-b5a1-4e34-a424-41d130ff60b6", "name": "network-vif-deleted", "tag": "04f81fac-5835-4383-819e-c1a0c737643b"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:46:35.714854 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-d10fc6ad-e2ce-4f36-ae77-a47ac4b72003 req-fecfadf0-6e62-463c-bc86-ec0a5bc36018 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:35.715369 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-d10fc6ad-e2ce-4f36-ae77-a47ac4b72003 req-fecfadf0-6e62-463c-bc86-ec0a5bc36018 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:35.727041 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-d10fc6ad-e2ce-4f36-ae77-a47ac4b72003 req-fecfadf0-6e62-463c-bc86-ec0a5bc36018 service nova] Creating event network-vif-deleted:04f81fac-5835-4383-819e-c1a0c737643b for instance 01cf8542-b5a1-4e34-a424-41d130ff60b6 on hv-cinder-82002 Jul 12 14:46:35.732123 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-d10fc6ad-e2ce-4f36-ae77-a47ac4b72003 req-fecfadf0-6e62-463c-bc86-ec0a5bc36018 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029463 Jul 12 14:46:35.732698 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 432/861] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:46:36.048467 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-35b3ba31-fa78-415b-b1ea-ae3049f79e0f tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:36.048992 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-35b3ba31-fa78-415b-b1ea-ae3049f79e0f tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:36.055395 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-35b3ba31-fa78-415b-b1ea-ae3049f79e0f tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:36.055842 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-35b3ba31-fa78-415b-b1ea-ae3049f79e0f tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:36.056676 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-35b3ba31-fa78-415b-b1ea-ae3049f79e0f tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:36.057114 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-35b3ba31-fa78-415b-b1ea-ae3049f79e0f tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:36.124858 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-35b3ba31-fa78-415b-b1ea-ae3049f79e0f tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:36.133363 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-35b3ba31-fa78-415b-b1ea-ae3049f79e0f tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1225 microversion: 2.1 time: 0.088776 Jul 12 14:46:36.133924 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 430/862] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:36 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:36.371211 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-24ec988a-4ea0-48fb-9c9c-01a3f6e5720c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:36.371902 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-24ec988a-4ea0-48fb-9c9c-01a3f6e5720c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:36.378805 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-24ec988a-4ea0-48fb-9c9c-01a3f6e5720c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:36.379927 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-24ec988a-4ea0-48fb-9c9c-01a3f6e5720c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:36.380699 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-24ec988a-4ea0-48fb-9c9c-01a3f6e5720c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:36.381342 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-24ec988a-4ea0-48fb-9c9c-01a3f6e5720c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:36.538727 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-24ec988a-4ea0-48fb-9c9c-01a3f6e5720c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:36.546940 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-24ec988a-4ea0-48fb-9c9c-01a3f6e5720c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:36.548434 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-24ec988a-4ea0-48fb-9c9c-01a3f6e5720c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:36.549736 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-24ec988a-4ea0-48fb-9c9c-01a3f6e5720c tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1729 microversion: 2.20 time: 0.183113 Jul 12 14:46:36.550483 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 433/863] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:36 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:37.151238 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ce55f2b0-7892-4064-9866-98f229100007 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:37.151884 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-ce55f2b0-7892-4064-9866-98f229100007 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:37.158525 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ce55f2b0-7892-4064-9866-98f229100007 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:37.161114 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ce55f2b0-7892-4064-9866-98f229100007 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:37.161114 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ce55f2b0-7892-4064-9866-98f229100007 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:37.161114 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ce55f2b0-7892-4064-9866-98f229100007 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:37.193992 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ce55f2b0-7892-4064-9866-98f229100007 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:37.194471 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ce55f2b0-7892-4064-9866-98f229100007 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:37.194919 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.objects.instance [None req-ce55f2b0-7892-4064-9866-98f229100007 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lazy-loading 'fault' on Instance uuid 01cf8542-b5a1-4e34-a424-41d130ff60b6 {{(pid=129980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:46:37.237181 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ce55f2b0-7892-4064-9866-98f229100007 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:37.244775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ce55f2b0-7892-4064-9866-98f229100007 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 200 len: 1230 microversion: 2.1 time: 0.098160 Jul 12 14:46:37.245372 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 431/864] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:37 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:37.569401 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-014e3d90-8435-4ef0-8184-4d761f8c3d2e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:37.570177 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-014e3d90-8435-4ef0-8184-4d761f8c3d2e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:37.586091 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-014e3d90-8435-4ef0-8184-4d761f8c3d2e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:37.586609 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-014e3d90-8435-4ef0-8184-4d761f8c3d2e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:37.587385 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-014e3d90-8435-4ef0-8184-4d761f8c3d2e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:37.587822 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-014e3d90-8435-4ef0-8184-4d761f8c3d2e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:37.723582 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-014e3d90-8435-4ef0-8184-4d761f8c3d2e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:37.731766 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-014e3d90-8435-4ef0-8184-4d761f8c3d2e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:37.733535 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-014e3d90-8435-4ef0-8184-4d761f8c3d2e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:37.735485 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-014e3d90-8435-4ef0-8184-4d761f8c3d2e tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1729 microversion: 2.20 time: 0.170845 Jul 12 14:46:37.736049 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 434/865] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:37 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:46:38.262373 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0d603666-e179-4469-9e8d-1f35c0363a61 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:38.263071 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-0d603666-e179-4469-9e8d-1f35c0363a61 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:38.270404 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0d603666-e179-4469-9e8d-1f35c0363a61 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:38.270859 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0d603666-e179-4469-9e8d-1f35c0363a61 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:38.271620 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0d603666-e179-4469-9e8d-1f35c0363a61 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:38.272059 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0d603666-e179-4469-9e8d-1f35c0363a61 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:38.286215 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.wsgi [None req-0d603666-e179-4469-9e8d-1f35c0363a61 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] HTTP exception thrown: Instance 01cf8542-b5a1-4e34-a424-41d130ff60b6 could not be found. Jul 12 14:46:38.287864 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0d603666-e179-4469-9e8d-1f35c0363a61 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Request method failure captured: Jul 12 14:46:38.287864 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: request: GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 HTTP/1.1 Jul 12 14:46:38.287864 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept: application/json Jul 12 14:46:38.287864 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept-Encoding: identity Jul 12 14:46:38.287864 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Connection: close Jul 12 14:46:38.287864 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Length: 0 Jul 12 14:46:38.287864 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Type: application/json Jul 12 14:46:38.287864 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Host: 10.222.0.30 Jul 12 14:46:38.287864 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Openstack-System-Scope: None Jul 12 14:46:38.287864 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: User-Agent: python-urllib3/1.26.9 Jul 12 14:46:38.287864 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Auth-Token: gAAAAABizYiGjCIym6z7ILJLfgL5E7gSAaaEOfOvjScRoYkA2P5sV3l8LkGEy4FK246dlmLiBGEvuQLFzzVtPzEU-tjVx2ALpJ5bYbXLk3W_B29wKNoYAB1IBrjJdWJs_NfQV0TzQfZtzAzhqBpKyvD2ZxojTAbUH-xPxNyB_WulntIblw69vIU Jul 12 14:46:38.287864 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Id: None Jul 12 14:46:38.287864 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Name: None Jul 12 14:46:38.287864 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Identity-Status: Confirmed Jul 12 14:46:38.287864 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Is-Admin-Project: True Jul 12 14:46:38.287864 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Id: default Jul 12 14:46:38.287864 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Name: Default Jul 12 14:46:38.287864 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Id: c361a671e3fc43c8a536f6526dc530b1 Jul 12 14:46:38.287864 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Name: tempest-TestVolumeBootPattern-616836979 Jul 12 14:46:38.287864 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Role: member,reader Jul 12 14:46:38.287864 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Roles: member,reader Jul 12 14:46:38.289550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c361a671e3fc43c8a536f6526dc530b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c361a671e3fc43c8a536f6526dc530b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c361a671e3fc43c8a536f6526dc530b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c361a671e3fc43c8a536f6526dc530b1", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:46:38.289550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant: tempest-TestVolumeBootPattern-616836979 Jul 12 14:46:38.289550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Id: c361a671e3fc43c8a536f6526dc530b1 Jul 12 14:46:38.289550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Name: tempest-TestVolumeBootPattern-616836979 Jul 12 14:46:38.289550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User: tempest-TestVolumeBootPattern-616836979-project Jul 12 14:46:38.289550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Id: default Jul 12 14:46:38.289550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Name: Default Jul 12 14:46:38.289550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Id: 917bfc7c68384536a6945af83308f789 Jul 12 14:46:38.289550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Name: tempest-TestVolumeBootPattern-616836979-project Jul 12 14:46:38.289550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: method: > Jul 12 14:46:38.289550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: exception: Instance 01cf8542-b5a1-4e34-a424-41d130ff60b6 could not be found. Jul 12 14:46:38.289550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: action_args: {'id': '01cf8542-b5a1-4e34-a424-41d130ff60b6'} Jul 12 14:46:38.290545 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:46:38.290545 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:46:38.290545 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:46:38.290545 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:46:38.290545 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:46:38.290545 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:46:38.290545 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:46:38.290545 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:46:38.290545 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:46:38.290545 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:46:38.290545 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01cf8542-b5a1-4e34-a424-41d130ff60b6 could not be found. Jul 12 14:46:38.290545 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:46:38.290545 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:46:38.290545 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:46:38.290545 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:46:38.290545 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:46:38.290545 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:46:38.290545 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:46:38.290545 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:46:38.290545 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:46:38.291838 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:46:38.291838 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:46:38.291838 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:46:38.291838 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:46:38.291838 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:46:38.291838 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:46:38.291838 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:46:38.291838 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01cf8542-b5a1-4e34-a424-41d130ff60b6 could not be found. Jul 12 14:46:38.291838 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:46:38.291838 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:46:38.291838 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:46:38.291838 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:46:38.291838 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:46:38.291838 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:46:38.291838 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:46:38.291838 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:46:38.291838 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01cf8542-b5a1-4e34-a424-41d130ff60b6 could not be found. Jul 12 14:46:38.291838 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:46:38.293025 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0d603666-e179-4469-9e8d-1f35c0363a61 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Returning 404 to user: Instance 01cf8542-b5a1-4e34-a424-41d130ff60b6 could not be found. {{(pid=129980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:46:38.293025 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-0d603666-e179-4469-9e8d-1f35c0363a61 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 404 len: 111 microversion: 2.1 time: 0.030884 Jul 12 14:46:38.293025 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 432/866] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:38 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:46:38.405262 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-41a2fdca-2833-47ab-9c71-3222e95b3daf tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-90032942", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-616226702", "security_groups": [{"name": "tempest-secgroup-smoke-1839065815"}], "block_device_mapping_v2": [{"uuid": "93dd7901-5dd0-4397-bc70-7a4faa8ad307", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "053ecff6-71cf-4863-84fc-402dc3a5230b"}]}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:46:38.520281 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.network.neutron [None req-41a2fdca-2833-47ab-9c71-3222e95b3daf tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] validate_networks() for [('053ecff6-71cf-4863-84fc-402dc3a5230b', None, None, None, None, None)] {{(pid=129981) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:46:38.754882 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-6268b6a4-042b-4648-8391-a8b0a58f3886 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:38.755975 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-6268b6a4-042b-4648-8391-a8b0a58f3886 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:38.761373 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6268b6a4-042b-4648-8391-a8b0a58f3886 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:38.761823 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6268b6a4-042b-4648-8391-a8b0a58f3886 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:38.762582 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6268b6a4-042b-4648-8391-a8b0a58f3886 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:38.763016 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6268b6a4-042b-4648-8391-a8b0a58f3886 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:38.767004 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:38.979331 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-6268b6a4-042b-4648-8391-a8b0a58f3886 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:38.988166 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-6268b6a4-042b-4648-8391-a8b0a58f3886 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:38.989489 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-6268b6a4-042b-4648-8391-a8b0a58f3886 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:38.990670 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-6268b6a4-042b-4648-8391-a8b0a58f3886 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1716 microversion: 2.20 time: 0.240477 Jul 12 14:46:38.991230 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 433/867] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:46:38 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1716 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:46:39.077092 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-41a2fdca-2833-47ab-9c71-3222e95b3daf tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Flavor limits 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:46:39.077583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-41a2fdca-2833-47ab-9c71-3222e95b3daf tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Image limits 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:46:39.078015 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-41a2fdca-2833-47ab-9c71-3222e95b3daf tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Flavor pref 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:46:39.078419 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-41a2fdca-2833-47ab-9c71-3222e95b3daf tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Image pref 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:46:39.078830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-41a2fdca-2833-47ab-9c71-3222e95b3daf tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:46:39.087570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-41a2fdca-2833-47ab-9c71-3222e95b3daf tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:39.088016 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-41a2fdca-2833-47ab-9c71-3222e95b3daf tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:39.088810 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-41a2fdca-2833-47ab-9c71-3222e95b3daf tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:39.089291 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-41a2fdca-2833-47ab-9c71-3222e95b3daf tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:39.106989 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.quota [None req-41a2fdca-2833-47ab-9c71-3222e95b3daf tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Getting quotas for project c361a671e3fc43c8a536f6526dc530b1. Resources: {'instances', 'cores', 'ram'} {{(pid=129981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:46:39.110953 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.quota [None req-41a2fdca-2833-47ab-9c71-3222e95b3daf tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Getting quotas for user 917bfc7c68384536a6945af83308f789 and project c361a671e3fc43c8a536f6526dc530b1. Resources: {'instances', 'cores', 'ram'} {{(pid=129981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:46:39.169966 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-41a2fdca-2833-47ab-9c71-3222e95b3daf tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Going to run 1 instances... {{(pid=129981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:46:39.172094 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-41a2fdca-2833-47ab-9c71-3222e95b3daf tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='93dd7901-5dd0-4397-bc70-7a4faa8ad307',volume_size=None,volume_type=None)] {{(pid=129981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:46:39.576832 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-41a2fdca-2833-47ab-9c71-3222e95b3daf tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.175406 Jul 12 14:46:39.577517 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 435/868] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Jul 12 14:46:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:46:39.588024 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-901d6197-bbeb-44a0-8562-6e80fc7e0c12 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:39.588638 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-901d6197-bbeb-44a0-8562-6e80fc7e0c12 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:39.646667 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-901d6197-bbeb-44a0-8562-6e80fc7e0c12 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:39.653859 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-901d6197-bbeb-44a0-8562-6e80fc7e0c12 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 200 len: 1092 microversion: 2.1 time: 0.069689 Jul 12 14:46:39.654504 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 434/869] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:39 2022] GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 1092 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:40.671657 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-3f10beac-a582-452e-b777-89b8161411ff tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:40.672381 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-3f10beac-a582-452e-b777-89b8161411ff tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:40.674449 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:40.680835 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3f10beac-a582-452e-b777-89b8161411ff tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:40.681332 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3f10beac-a582-452e-b777-89b8161411ff tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:40.682122 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3f10beac-a582-452e-b777-89b8161411ff tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:40.682573 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3f10beac-a582-452e-b777-89b8161411ff tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:40.744953 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-3f10beac-a582-452e-b777-89b8161411ff tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:40.752773 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-3f10beac-a582-452e-b777-89b8161411ff tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 200 len: 1142 microversion: 2.1 time: 0.085893 Jul 12 14:46:40.753377 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 436/870] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:40 2022] GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 1142 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:41.769747 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-308d09f6-58b9-4a17-815e-cd19ef2d63c3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:41.770458 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-308d09f6-58b9-4a17-815e-cd19ef2d63c3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:41.777710 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-308d09f6-58b9-4a17-815e-cd19ef2d63c3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:41.778160 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-308d09f6-58b9-4a17-815e-cd19ef2d63c3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:41.778924 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-308d09f6-58b9-4a17-815e-cd19ef2d63c3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:41.779358 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-308d09f6-58b9-4a17-815e-cd19ef2d63c3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:41.853999 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-308d09f6-58b9-4a17-815e-cd19ef2d63c3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:41.861814 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-308d09f6-58b9-4a17-815e-cd19ef2d63c3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 200 len: 1198 microversion: 2.1 time: 0.095847 Jul 12 14:46:41.862426 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 435/871] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:41 2022] GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 1198 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:42.880746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-99bf02c7-06da-45bc-a211-53aaf0cf9011 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:42.881479 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-99bf02c7-06da-45bc-a211-53aaf0cf9011 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:42.888207 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-99bf02c7-06da-45bc-a211-53aaf0cf9011 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:42.888657 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-99bf02c7-06da-45bc-a211-53aaf0cf9011 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:42.889449 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-99bf02c7-06da-45bc-a211-53aaf0cf9011 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:42.889885 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-99bf02c7-06da-45bc-a211-53aaf0cf9011 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:43.058657 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-99bf02c7-06da-45bc-a211-53aaf0cf9011 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:43.066039 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-99bf02c7-06da-45bc-a211-53aaf0cf9011 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 200 len: 1276 microversion: 2.1 time: 0.190276 Jul 12 14:46:43.067018 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 437/872] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:42 2022] GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 1276 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:43.630068 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-7b53b7f3-f9e1-4941-b0fc-ffb3fe10461e req-66add8fc-8da1-4e50-9c4f-4c13327078a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48873689-94c9-4887-9b4b-7eca17ddd173", "tag": "561b44eb-0d73-4072-bb0f-14b66c4fd904"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:46:43.640487 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-7b53b7f3-f9e1-4941-b0fc-ffb3fe10461e req-66add8fc-8da1-4e50-9c4f-4c13327078a9 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:43.641070 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-7b53b7f3-f9e1-4941-b0fc-ffb3fe10461e req-66add8fc-8da1-4e50-9c4f-4c13327078a9 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:43.656600 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-7b53b7f3-f9e1-4941-b0fc-ffb3fe10461e req-66add8fc-8da1-4e50-9c4f-4c13327078a9 service nova] Creating event network-changed:561b44eb-0d73-4072-bb0f-14b66c4fd904 for instance 48873689-94c9-4887-9b4b-7eca17ddd173 on hv-cinder-82002 Jul 12 14:46:43.662555 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-7b53b7f3-f9e1-4941-b0fc-ffb3fe10461e req-66add8fc-8da1-4e50-9c4f-4c13327078a9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037382 Jul 12 14:46:43.663179 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 436/873] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:46:44.086835 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-9ffad34a-5a97-40aa-bb7f-6fd4c2772dc1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:44.088272 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-9ffad34a-5a97-40aa-bb7f-6fd4c2772dc1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:44.097057 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9ffad34a-5a97-40aa-bb7f-6fd4c2772dc1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:44.097535 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9ffad34a-5a97-40aa-bb7f-6fd4c2772dc1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:44.098303 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9ffad34a-5a97-40aa-bb7f-6fd4c2772dc1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:44.099287 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9ffad34a-5a97-40aa-bb7f-6fd4c2772dc1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:44.281929 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-9ffad34a-5a97-40aa-bb7f-6fd4c2772dc1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:44.290162 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-9ffad34a-5a97-40aa-bb7f-6fd4c2772dc1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 200 len: 1276 microversion: 2.1 time: 0.208911 Jul 12 14:46:44.290784 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 438/874] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:44 2022] GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 1276 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:46:44.409016 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-eb08a99b-9332-4782-b305-2b8e337e085d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:44.410624 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-eb08a99b-9332-4782-b305-2b8e337e085d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:44.418159 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-eb08a99b-9332-4782-b305-2b8e337e085d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:44.421341 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-eb08a99b-9332-4782-b305-2b8e337e085d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:44.421341 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-eb08a99b-9332-4782-b305-2b8e337e085d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:44.421341 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-eb08a99b-9332-4782-b305-2b8e337e085d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:44.451203 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-eb08a99b-9332-4782-b305-2b8e337e085d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046566 Jul 12 14:46:44.451906 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 437/875] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Jul 12 14:46:44 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:46:44.601964 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-0e53acdf-051f-4140-9d04-b82809847afd tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:44.602831 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-0e53acdf-051f-4140-9d04-b82809847afd tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:44.608614 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0e53acdf-051f-4140-9d04-b82809847afd tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:44.609076 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0e53acdf-051f-4140-9d04-b82809847afd tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:44.609874 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0e53acdf-051f-4140-9d04-b82809847afd tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:44.610312 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0e53acdf-051f-4140-9d04-b82809847afd tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:44.643115 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-0e53acdf-051f-4140-9d04-b82809847afd tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15/os-volume_attachments/b5d65b4b-47f6-4084-b940-35be76342e60" status: 200 len: 194 microversion: 2.1 time: 0.045575 Jul 12 14:46:44.643613 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 439/876] 10.222.0.30 () {58 vars in 1412 bytes} [Tue Jul 12 14:46:44 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15/os-volume_attachments/b5d65b4b-47f6-4084-b940-35be76342e60 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:46:44.654137 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-78f8c24b-8b5b-4712-a439-b7622ee055ab tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:44.654660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-78f8c24b-8b5b-4712-a439-b7622ee055ab tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:44.661835 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-78f8c24b-8b5b-4712-a439-b7622ee055ab tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:44.662286 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-78f8c24b-8b5b-4712-a439-b7622ee055ab tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:44.663039 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-78f8c24b-8b5b-4712-a439-b7622ee055ab tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:44.663468 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-78f8c24b-8b5b-4712-a439-b7622ee055ab tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:44.744711 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.objects.instance [None req-78f8c24b-8b5b-4712-a439-b7622ee055ab tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lazy-loading 'services' on Instance uuid 059eea39-a5fd-4428-8c51-5548bc8b0e15 {{(pid=129980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:46:44.980082 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-78f8c24b-8b5b-4712-a439-b7622ee055ab tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "DELETE /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15/os-volume_attachments/b5d65b4b-47f6-4084-b940-35be76342e60" status: 202 len: 0 microversion: 2.1 time: 0.329961 Jul 12 14:46:44.980671 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 438/877] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Jul 12 14:46:44 2022] DELETE /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15/os-volume_attachments/b5d65b4b-47f6-4084-b940-35be76342e60 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 14:46:45.307550 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-9127d9dd-27b6-471c-8042-b4457367286b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:45.308156 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-9127d9dd-27b6-471c-8042-b4457367286b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:45.314744 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9127d9dd-27b6-471c-8042-b4457367286b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:45.315152 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9127d9dd-27b6-471c-8042-b4457367286b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:45.316897 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9127d9dd-27b6-471c-8042-b4457367286b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:45.316897 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9127d9dd-27b6-471c-8042-b4457367286b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:45.458117 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-9127d9dd-27b6-471c-8042-b4457367286b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:45.467563 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-9127d9dd-27b6-471c-8042-b4457367286b tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 200 len: 1276 microversion: 2.1 time: 0.164158 Jul 12 14:46:45.468140 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 440/878] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:45 2022] GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 1276 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:46.486430 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-e352dbfc-a2eb-4fa0-b606-c662603fc80a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:46.487189 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-e352dbfc-a2eb-4fa0-b606-c662603fc80a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:46.494590 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e352dbfc-a2eb-4fa0-b606-c662603fc80a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:46.495037 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e352dbfc-a2eb-4fa0-b606-c662603fc80a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:46.495817 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e352dbfc-a2eb-4fa0-b606-c662603fc80a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:46.496230 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e352dbfc-a2eb-4fa0-b606-c662603fc80a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:46.633007 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-e352dbfc-a2eb-4fa0-b606-c662603fc80a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:46.640458 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-e352dbfc-a2eb-4fa0-b606-c662603fc80a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 200 len: 1264 microversion: 2.1 time: 0.159199 Jul 12 14:46:46.642966 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 439/879] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:46 2022] GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:47.657384 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-3c0fb301-2ce6-4242-909d-b678dde432f9 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:47.657945 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-3c0fb301-2ce6-4242-909d-b678dde432f9 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:47.664697 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3c0fb301-2ce6-4242-909d-b678dde432f9 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:47.665154 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3c0fb301-2ce6-4242-909d-b678dde432f9 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:47.665949 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3c0fb301-2ce6-4242-909d-b678dde432f9 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:47.666387 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3c0fb301-2ce6-4242-909d-b678dde432f9 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:47.804405 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-3c0fb301-2ce6-4242-909d-b678dde432f9 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:47.811862 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-3c0fb301-2ce6-4242-909d-b678dde432f9 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 200 len: 1264 microversion: 2.1 time: 0.158465 Jul 12 14:46:47.812433 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 441/880] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:47 2022] GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:48.196322 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-97ee0ae4-d596-40ee-9e52-fdc5e8d92b0a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:48.196854 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-97ee0ae4-d596-40ee-9e52-fdc5e8d92b0a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:48.203656 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-97ee0ae4-d596-40ee-9e52-fdc5e8d92b0a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:48.204101 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-97ee0ae4-d596-40ee-9e52-fdc5e8d92b0a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:48.204864 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-97ee0ae4-d596-40ee-9e52-fdc5e8d92b0a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:48.205355 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-97ee0ae4-d596-40ee-9e52-fdc5e8d92b0a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:48.233240 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-97ee0ae4-d596-40ee-9e52-fdc5e8d92b0a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15/os-volume_attachments/e77af7bd-d00c-4481-ad05-ca7cf1bfc272" status: 200 len: 194 microversion: 2.1 time: 0.041555 Jul 12 14:46:48.233804 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 440/881] 10.222.0.30 () {58 vars in 1412 bytes} [Tue Jul 12 14:46:48 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15/os-volume_attachments/e77af7bd-d00c-4481-ad05-ca7cf1bfc272 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:46:48.243998 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-8a08f28b-975a-4e4f-ad2e-2690f87c9b6e tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:48.244495 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-8a08f28b-975a-4e4f-ad2e-2690f87c9b6e tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:48.250476 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8a08f28b-975a-4e4f-ad2e-2690f87c9b6e tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:48.250926 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8a08f28b-975a-4e4f-ad2e-2690f87c9b6e tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:48.251681 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8a08f28b-975a-4e4f-ad2e-2690f87c9b6e tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:48.252615 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8a08f28b-975a-4e4f-ad2e-2690f87c9b6e tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:48.331465 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.objects.instance [None req-8a08f28b-975a-4e4f-ad2e-2690f87c9b6e tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lazy-loading 'services' on Instance uuid 059eea39-a5fd-4428-8c51-5548bc8b0e15 {{(pid=129981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:46:48.545583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-8a08f28b-975a-4e4f-ad2e-2690f87c9b6e tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "DELETE /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15/os-volume_attachments/e77af7bd-d00c-4481-ad05-ca7cf1bfc272" status: 202 len: 0 microversion: 2.1 time: 0.305817 Jul 12 14:46:48.546212 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 442/882] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Jul 12 14:46:48 2022] DELETE /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15/os-volume_attachments/e77af7bd-d00c-4481-ad05-ca7cf1bfc272 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:46:48.829025 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-c0b86cf9-f107-4f12-b5d9-50d79c88e176 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:48.829692 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-c0b86cf9-f107-4f12-b5d9-50d79c88e176 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:48.835651 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c0b86cf9-f107-4f12-b5d9-50d79c88e176 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:48.836100 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c0b86cf9-f107-4f12-b5d9-50d79c88e176 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:48.836846 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c0b86cf9-f107-4f12-b5d9-50d79c88e176 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:48.837311 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c0b86cf9-f107-4f12-b5d9-50d79c88e176 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:48.968313 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-c0b86cf9-f107-4f12-b5d9-50d79c88e176 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:48.975666 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-c0b86cf9-f107-4f12-b5d9-50d79c88e176 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 200 len: 1264 microversion: 2.1 time: 0.150522 Jul 12 14:46:48.976230 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 441/883] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:48 2022] GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:49.989643 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell0:SELECT=2 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:49.990993 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell0:SELECT=6 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:49.995011 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-a8da1230-569c-4d29-ba31-e90658223a71 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:49.999675 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-a8da1230-569c-4d29-ba31-e90658223a71 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:50.001835 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a8da1230-569c-4d29-ba31-e90658223a71 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:50.002551 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a8da1230-569c-4d29-ba31-e90658223a71 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:50.003312 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a8da1230-569c-4d29-ba31-e90658223a71 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:50.003771 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a8da1230-569c-4d29-ba31-e90658223a71 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:50.134533 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-a8da1230-569c-4d29-ba31-e90658223a71 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:50.142046 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-a8da1230-569c-4d29-ba31-e90658223a71 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 200 len: 1264 microversion: 2.1 time: 0.153901 Jul 12 14:46:50.142617 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 443/884] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:49 2022] GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:50.761754 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-56bb27d8-0e60-4036-ac3f-7107e846c16d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:50.762680 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-56bb27d8-0e60-4036-ac3f-7107e846c16d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:50.765078 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell0:SELECT=2 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:50.769913 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-56bb27d8-0e60-4036-ac3f-7107e846c16d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:50.770367 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-56bb27d8-0e60-4036-ac3f-7107e846c16d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:50.771126 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-56bb27d8-0e60-4036-ac3f-7107e846c16d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:50.772127 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-56bb27d8-0e60-4036-ac3f-7107e846c16d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:50.801011 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-56bb27d8-0e60-4036-ac3f-7107e846c16d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043197 Jul 12 14:46:50.801744 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 442/885] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Jul 12 14:46:50 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 14:46:50.904959 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-a4282ea2-acec-4635-ac94-00ccc3f90237 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:50.905965 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-a4282ea2-acec-4635-ac94-00ccc3f90237 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:50.912200 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a4282ea2-acec-4635-ac94-00ccc3f90237 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:50.916361 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a4282ea2-acec-4635-ac94-00ccc3f90237 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:50.916361 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a4282ea2-acec-4635-ac94-00ccc3f90237 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:50.916361 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a4282ea2-acec-4635-ac94-00ccc3f90237 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:50.941507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-a4282ea2-acec-4635-ac94-00ccc3f90237 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040391 Jul 12 14:46:50.942055 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 444/886] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Jul 12 14:46:50 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 14:46:50.998998 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-88c56a52-5fa8-4f83-a3d1-d2be296c918f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:50.999497 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-88c56a52-5fa8-4f83-a3d1-d2be296c918f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:51.006808 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-88c56a52-5fa8-4f83-a3d1-d2be296c918f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:51.007258 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-88c56a52-5fa8-4f83-a3d1-d2be296c918f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:51.008022 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-88c56a52-5fa8-4f83-a3d1-d2be296c918f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:51.008463 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-88c56a52-5fa8-4f83-a3d1-d2be296c918f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:51.033112 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-88c56a52-5fa8-4f83-a3d1-d2be296c918f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Going to try to terminate instance {{(pid=129980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:46:51.158802 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-cde5a8ce-9a33-4ec2-a8b4-38ea804e54a4 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:51.159408 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-cde5a8ce-9a33-4ec2-a8b4-38ea804e54a4 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:51.165843 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-cde5a8ce-9a33-4ec2-a8b4-38ea804e54a4 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:51.166290 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-cde5a8ce-9a33-4ec2-a8b4-38ea804e54a4 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:51.167103 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-cde5a8ce-9a33-4ec2-a8b4-38ea804e54a4 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:51.167484 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-cde5a8ce-9a33-4ec2-a8b4-38ea804e54a4 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:51.299782 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-cde5a8ce-9a33-4ec2-a8b4-38ea804e54a4 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:51.307998 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-cde5a8ce-9a33-4ec2-a8b4-38ea804e54a4 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 200 len: 1264 microversion: 2.1 time: 0.153278 Jul 12 14:46:51.308637 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 445/887] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:51 2022] GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:46:51.323535 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-88c56a52-5fa8-4f83-a3d1-d2be296c918f tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "DELETE /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15" status: 204 len: 0 microversion: 2.1 time: 0.328132 Jul 12 14:46:51.324132 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 443/888] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Jul 12 14:46:50 2022] DELETE /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:46:51.338174 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-837d1729-a5bc-4466-84ff-ac0ba7fa3b06 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:51.338800 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-837d1729-a5bc-4466-84ff-ac0ba7fa3b06 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:51.344668 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-837d1729-a5bc-4466-84ff-ac0ba7fa3b06 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:51.345278 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-837d1729-a5bc-4466-84ff-ac0ba7fa3b06 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:51.346033 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-837d1729-a5bc-4466-84ff-ac0ba7fa3b06 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:51.346465 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-837d1729-a5bc-4466-84ff-ac0ba7fa3b06 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:51.485851 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-837d1729-a5bc-4466-84ff-ac0ba7fa3b06 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:51.493621 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:51.496225 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-837d1729-a5bc-4466-84ff-ac0ba7fa3b06 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15" status: 200 len: 1674 microversion: 2.1 time: 0.162021 Jul 12 14:46:51.496851 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 446/889] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:51 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:46:52.325603 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-6f20a1f3-b140-4eaf-ac74-775041b666ab tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:52.326202 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-6f20a1f3-b140-4eaf-ac74-775041b666ab tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:52.332645 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6f20a1f3-b140-4eaf-ac74-775041b666ab tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:52.333086 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6f20a1f3-b140-4eaf-ac74-775041b666ab tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:52.334496 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6f20a1f3-b140-4eaf-ac74-775041b666ab tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:52.334936 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6f20a1f3-b140-4eaf-ac74-775041b666ab tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:52.464173 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-6f20a1f3-b140-4eaf-ac74-775041b666ab tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:52.471637 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-6f20a1f3-b140-4eaf-ac74-775041b666ab tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 200 len: 1264 microversion: 2.1 time: 0.150368 Jul 12 14:46:52.472201 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 444/890] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:52 2022] GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:52.514767 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c75c2abc-683b-48f5-b7da-f9d477531b9a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:52.515371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-c75c2abc-683b-48f5-b7da-f9d477531b9a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:52.522788 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c75c2abc-683b-48f5-b7da-f9d477531b9a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:52.523238 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c75c2abc-683b-48f5-b7da-f9d477531b9a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:52.523982 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c75c2abc-683b-48f5-b7da-f9d477531b9a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:52.524409 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c75c2abc-683b-48f5-b7da-f9d477531b9a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:52.655452 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c75c2abc-683b-48f5-b7da-f9d477531b9a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:52.663111 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-c75c2abc-683b-48f5-b7da-f9d477531b9a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15" status: 200 len: 1674 microversion: 2.1 time: 0.152495 Jul 12 14:46:52.663687 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 447/891] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:52 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:53.488207 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-f5f69d28-bedd-47f3-836b-5d4934f21063 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:53.488831 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-f5f69d28-bedd-47f3-836b-5d4934f21063 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:53.495338 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f5f69d28-bedd-47f3-836b-5d4934f21063 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:53.495794 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f5f69d28-bedd-47f3-836b-5d4934f21063 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:53.496591 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f5f69d28-bedd-47f3-836b-5d4934f21063 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:53.497031 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f5f69d28-bedd-47f3-836b-5d4934f21063 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:53.627791 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-f5f69d28-bedd-47f3-836b-5d4934f21063 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:53.635280 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-f5f69d28-bedd-47f3-836b-5d4934f21063 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 200 len: 1264 microversion: 2.1 time: 0.150907 Jul 12 14:46:53.635847 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 445/892] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:53 2022] GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:53.679767 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-0f4ec658-49ed-470f-abaf-a96b39f35386 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:53.680410 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-0f4ec658-49ed-470f-abaf-a96b39f35386 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:53.686967 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0f4ec658-49ed-470f-abaf-a96b39f35386 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:53.687414 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0f4ec658-49ed-470f-abaf-a96b39f35386 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:53.688179 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0f4ec658-49ed-470f-abaf-a96b39f35386 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:53.688614 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0f4ec658-49ed-470f-abaf-a96b39f35386 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:53.816878 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-0f4ec658-49ed-470f-abaf-a96b39f35386 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:53.824846 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-0f4ec658-49ed-470f-abaf-a96b39f35386 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15" status: 200 len: 1674 microversion: 2.1 time: 0.149027 Jul 12 14:46:53.825450 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 448/893] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:53 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:54.651761 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-63864e0d-1c1f-4434-8c83-c0d13c1e266f tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:54.652400 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-63864e0d-1c1f-4434-8c83-c0d13c1e266f tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:54.658935 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-63864e0d-1c1f-4434-8c83-c0d13c1e266f tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:54.659382 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-63864e0d-1c1f-4434-8c83-c0d13c1e266f tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:54.660137 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-63864e0d-1c1f-4434-8c83-c0d13c1e266f tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:54.660571 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-63864e0d-1c1f-4434-8c83-c0d13c1e266f tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:54.789660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-63864e0d-1c1f-4434-8c83-c0d13c1e266f tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:54.796884 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-63864e0d-1c1f-4434-8c83-c0d13c1e266f tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 200 len: 1264 microversion: 2.1 time: 0.148946 Jul 12 14:46:54.797467 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 446/894] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:54 2022] GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:54.842563 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-f83433cc-d70d-432d-a7a9-05575f0df92c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:54.843177 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-f83433cc-d70d-432d-a7a9-05575f0df92c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:54.850109 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f83433cc-d70d-432d-a7a9-05575f0df92c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:54.850560 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f83433cc-d70d-432d-a7a9-05575f0df92c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:54.851321 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f83433cc-d70d-432d-a7a9-05575f0df92c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:54.851755 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f83433cc-d70d-432d-a7a9-05575f0df92c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:54.976921 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-f83433cc-d70d-432d-a7a9-05575f0df92c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:54.984454 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-f83433cc-d70d-432d-a7a9-05575f0df92c tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15" status: 200 len: 1674 microversion: 2.1 time: 0.145699 Jul 12 14:46:54.985023 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 449/895] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:54 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 => generated 1674 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:55.814410 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-5686319c-b96e-4b28-9c9e-f9adb1d5438a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:55.814950 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-5686319c-b96e-4b28-9c9e-f9adb1d5438a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:55.822043 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5686319c-b96e-4b28-9c9e-f9adb1d5438a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:55.822497 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5686319c-b96e-4b28-9c9e-f9adb1d5438a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:55.823268 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5686319c-b96e-4b28-9c9e-f9adb1d5438a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:55.823704 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5686319c-b96e-4b28-9c9e-f9adb1d5438a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:55.956716 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-5686319c-b96e-4b28-9c9e-f9adb1d5438a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:55.964189 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-5686319c-b96e-4b28-9c9e-f9adb1d5438a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 200 len: 1264 microversion: 2.1 time: 0.153696 Jul 12 14:46:55.964755 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 447/896] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:55 2022] GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:56.003427 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-0acaa2c7-0ed0-4027-ba75-8fd86697cc54 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:56.004035 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-0acaa2c7-0ed0-4027-ba75-8fd86697cc54 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:56.011180 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0acaa2c7-0ed0-4027-ba75-8fd86697cc54 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:56.011631 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0acaa2c7-0ed0-4027-ba75-8fd86697cc54 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:56.012547 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0acaa2c7-0ed0-4027-ba75-8fd86697cc54 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:56.012925 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0acaa2c7-0ed0-4027-ba75-8fd86697cc54 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:56.140627 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-0acaa2c7-0ed0-4027-ba75-8fd86697cc54 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:56.148143 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-0acaa2c7-0ed0-4027-ba75-8fd86697cc54 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15" status: 200 len: 1674 microversion: 2.1 time: 0.149148 Jul 12 14:46:56.148712 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 450/897] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:55 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:56.986294 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-1b79295e-84a2-4202-906f-af433c3fc59c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:56.986900 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-1b79295e-84a2-4202-906f-af433c3fc59c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:56.993448 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1b79295e-84a2-4202-906f-af433c3fc59c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:56.993998 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1b79295e-84a2-4202-906f-af433c3fc59c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:56.994758 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1b79295e-84a2-4202-906f-af433c3fc59c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:56.995235 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1b79295e-84a2-4202-906f-af433c3fc59c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:57.133359 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-1b79295e-84a2-4202-906f-af433c3fc59c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:57.143835 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-1b79295e-84a2-4202-906f-af433c3fc59c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 200 len: 1264 microversion: 2.1 time: 0.161209 Jul 12 14:46:57.144709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 448/898] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:56 2022] GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:46:57.166051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-19f96bd8-738f-4211-ae2e-0eba5a19740b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:57.166672 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-19f96bd8-738f-4211-ae2e-0eba5a19740b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:57.173405 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-19f96bd8-738f-4211-ae2e-0eba5a19740b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:57.173865 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-19f96bd8-738f-4211-ae2e-0eba5a19740b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:57.174742 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-19f96bd8-738f-4211-ae2e-0eba5a19740b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:57.175347 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-19f96bd8-738f-4211-ae2e-0eba5a19740b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:57.390567 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-19f96bd8-738f-4211-ae2e-0eba5a19740b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:57.398069 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-19f96bd8-738f-4211-ae2e-0eba5a19740b tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15" status: 200 len: 1674 microversion: 2.1 time: 0.236205 Jul 12 14:46:57.398644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 451/899] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:57 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 => generated 1674 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:58.195586 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-97cbf062-0957-48f5-bd00-bb85848802e6 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:58.197011 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-97cbf062-0957-48f5-bd00-bb85848802e6 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:58.203512 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-97cbf062-0957-48f5-bd00-bb85848802e6 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:58.203962 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-97cbf062-0957-48f5-bd00-bb85848802e6 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:58.205109 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-97cbf062-0957-48f5-bd00-bb85848802e6 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:58.205766 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-97cbf062-0957-48f5-bd00-bb85848802e6 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:58.210865 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:58.416428 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-bd704453-b1d9-4f1b-b4cf-291a71cdba9d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:58.417438 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-bd704453-b1d9-4f1b-b4cf-291a71cdba9d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:58.434884 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bd704453-b1d9-4f1b-b4cf-291a71cdba9d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:58.434884 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bd704453-b1d9-4f1b-b4cf-291a71cdba9d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:58.434884 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bd704453-b1d9-4f1b-b4cf-291a71cdba9d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:58.435459 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bd704453-b1d9-4f1b-b4cf-291a71cdba9d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:58.441138 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-97cbf062-0957-48f5-bd00-bb85848802e6 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:58.456490 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-97cbf062-0957-48f5-bd00-bb85848802e6 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 200 len: 1264 microversion: 2.1 time: 0.265145 Jul 12 14:46:58.457354 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 449/900] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:58 2022] GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 1264 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:58.484189 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-36c61663-091b-47a1-a4eb-b075d751e56f req-5f3f3154-060e-45b3-b733-94c2e58f4628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "059eea39-a5fd-4428-8c51-5548bc8b0e15", "name": "network-vif-deleted", "tag": "ff00788d-9218-4980-97fc-18cd7b346c4a"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:46:58.501301 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-36c61663-091b-47a1-a4eb-b075d751e56f req-5f3f3154-060e-45b3-b733-94c2e58f4628 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:58.503127 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-36c61663-091b-47a1-a4eb-b075d751e56f req-5f3f3154-060e-45b3-b733-94c2e58f4628 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:58.519884 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-36c61663-091b-47a1-a4eb-b075d751e56f req-5f3f3154-060e-45b3-b733-94c2e58f4628 service nova] Creating event network-vif-deleted:ff00788d-9218-4980-97fc-18cd7b346c4a for instance 059eea39-a5fd-4428-8c51-5548bc8b0e15 on hv-cinder-82002 Jul 12 14:46:58.525722 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-36c61663-091b-47a1-a4eb-b075d751e56f req-5f3f3154-060e-45b3-b733-94c2e58f4628 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045557 Jul 12 14:46:58.527004 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 450/901] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:46:58.546308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-bd704453-b1d9-4f1b-b4cf-291a71cdba9d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:58.555391 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-bd704453-b1d9-4f1b-b4cf-291a71cdba9d tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15" status: 200 len: 1607 microversion: 2.1 time: 0.143476 Jul 12 14:46:58.565322 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 452/902] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:58 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 => generated 1607 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:59.473995 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0f44c7dd-18a6-45fb-86df-0a9fdb4de9fa tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:59.474733 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-0f44c7dd-18a6-45fb-86df-0a9fdb4de9fa tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:59.480971 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0f44c7dd-18a6-45fb-86df-0a9fdb4de9fa tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:59.481435 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0f44c7dd-18a6-45fb-86df-0a9fdb4de9fa tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:59.482204 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0f44c7dd-18a6-45fb-86df-0a9fdb4de9fa tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:59.482658 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0f44c7dd-18a6-45fb-86df-0a9fdb4de9fa tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:59.578515 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-4204d1ff-5f92-4131-bac1-0ef71163c452 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:59.579134 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-4204d1ff-5f92-4131-bac1-0ef71163c452 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:59.589914 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4204d1ff-5f92-4131-bac1-0ef71163c452 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:59.589914 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4204d1ff-5f92-4131-bac1-0ef71163c452 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:59.591845 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4204d1ff-5f92-4131-bac1-0ef71163c452 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:59.591845 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4204d1ff-5f92-4131-bac1-0ef71163c452 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:59.644283 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-0f44c7dd-18a6-45fb-86df-0a9fdb4de9fa tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:59.657503 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-0f44c7dd-18a6-45fb-86df-0a9fdb4de9fa tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 200 len: 1264 microversion: 2.1 time: 0.187971 Jul 12 14:46:59.661229 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 451/903] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:59 2022] GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 1264 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:46:59.791667 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4204d1ff-5f92-4131-bac1-0ef71163c452 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:59.792115 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4204d1ff-5f92-4131-bac1-0ef71163c452 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:59.792572 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.objects.instance [None req-4204d1ff-5f92-4131-bac1-0ef71163c452 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lazy-loading 'fault' on Instance uuid 059eea39-a5fd-4428-8c51-5548bc8b0e15 {{(pid=129981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:46:59.834666 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-4204d1ff-5f92-4131-bac1-0ef71163c452 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f118c0ba8494e6e9f5a4488ebf8d220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52569bf4eba24c2a9fa0ef8c26b8b22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:59.841835 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-4204d1ff-5f92-4131-bac1-0ef71163c452 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15" status: 200 len: 1327 microversion: 2.1 time: 0.271673 Jul 12 14:46:59.842476 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 453/904] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:59 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 => generated 1327 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:00.326810 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-ceefa700-e98a-4adf-921e-9e727eacc851 req-73f419e0-4c84-458f-b818-f489532c6d9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48873689-94c9-4887-9b4b-7eca17ddd173", "name": "network-vif-plugged", "status": "completed", "tag": "561b44eb-0d73-4072-bb0f-14b66c4fd904"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:47:00.336646 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-ceefa700-e98a-4adf-921e-9e727eacc851 req-73f419e0-4c84-458f-b818-f489532c6d9a service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:00.336646 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-ceefa700-e98a-4adf-921e-9e727eacc851 req-73f419e0-4c84-458f-b818-f489532c6d9a service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:00.347819 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-ceefa700-e98a-4adf-921e-9e727eacc851 req-73f419e0-4c84-458f-b818-f489532c6d9a service nova] Creating event network-vif-plugged:561b44eb-0d73-4072-bb0f-14b66c4fd904 for instance 48873689-94c9-4887-9b4b-7eca17ddd173 on hv-cinder-82002 Jul 12 14:47:00.353432 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-ceefa700-e98a-4adf-921e-9e727eacc851 req-73f419e0-4c84-458f-b818-f489532c6d9a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030185 Jul 12 14:47:00.354022 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 452/905] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:47:00.676045 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-2b2efd93-9846-4ace-b303-2e5b979d536a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:00.677468 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-2b2efd93-9846-4ace-b303-2e5b979d536a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:00.684881 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2b2efd93-9846-4ace-b303-2e5b979d536a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:00.685368 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2b2efd93-9846-4ace-b303-2e5b979d536a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:00.686170 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2b2efd93-9846-4ace-b303-2e5b979d536a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:00.686648 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2b2efd93-9846-4ace-b303-2e5b979d536a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:00.843755 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-2b2efd93-9846-4ace-b303-2e5b979d536a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:00.851788 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-2b2efd93-9846-4ace-b303-2e5b979d536a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 200 len: 1264 microversion: 2.1 time: 0.179854 Jul 12 14:47:00.852344 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 454/906] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:00 2022] GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:00.859983 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-d2ee078b-10d9-42a5-95ba-6c5bea849799 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:00.860688 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-d2ee078b-10d9-42a5-95ba-6c5bea849799 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:00.863138 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:47:00.868617 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d2ee078b-10d9-42a5-95ba-6c5bea849799 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:00.869078 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d2ee078b-10d9-42a5-95ba-6c5bea849799 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:00.869865 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d2ee078b-10d9-42a5-95ba-6c5bea849799 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:00.870298 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d2ee078b-10d9-42a5-95ba-6c5bea849799 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:00.884140 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.wsgi [None req-d2ee078b-10d9-42a5-95ba-6c5bea849799 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] HTTP exception thrown: Instance 059eea39-a5fd-4428-8c51-5548bc8b0e15 could not be found. Jul 12 14:47:00.885791 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-d2ee078b-10d9-42a5-95ba-6c5bea849799 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Request method failure captured: Jul 12 14:47:00.885791 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: request: GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 HTTP/1.1 Jul 12 14:47:00.885791 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept: application/json Jul 12 14:47:00.885791 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept-Encoding: identity Jul 12 14:47:00.885791 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Connection: close Jul 12 14:47:00.885791 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Length: 0 Jul 12 14:47:00.885791 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Type: application/json Jul 12 14:47:00.885791 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Host: 10.222.0.30 Jul 12 14:47:00.885791 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Openstack-System-Scope: None Jul 12 14:47:00.885791 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: User-Agent: python-urllib3/1.26.9 Jul 12 14:47:00.885791 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Auth-Token: gAAAAABizYefRPL1Y5GiliCzIK08041f1Xxv1Ly2Io92QPGJA-es3aoqpvK1tGkAqQB5fyoYZ3ClU870S111187SuwpRMPJRyhk3AsIKs4BN17uqZUvFCQEi7vdAzPhV4xJpo7kqnPIrySsHTNx3xSjU6VY6elQK0bX17gwzq2pB_ccF3Vb95iQ Jul 12 14:47:00.885791 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Id: None Jul 12 14:47:00.885791 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Name: None Jul 12 14:47:00.885791 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Identity-Status: Confirmed Jul 12 14:47:00.885791 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Is-Admin-Project: True Jul 12 14:47:00.885791 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Id: default Jul 12 14:47:00.885791 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Name: Default Jul 12 14:47:00.885791 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Id: 52569bf4eba24c2a9fa0ef8c26b8b22d Jul 12 14:47:00.885791 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Name: tempest-AttachVolumeTestJSON-1798153056 Jul 12 14:47:00.885791 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Role: member,reader Jul 12 14:47:00.885791 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Roles: member,reader Jul 12 14:47:00.887922 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/52569bf4eba24c2a9fa0ef8c26b8b22d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/52569bf4eba24c2a9fa0ef8c26b8b22d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/52569bf4eba24c2a9fa0ef8c26b8b22d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_52569bf4eba24c2a9fa0ef8c26b8b22d", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:47:00.887922 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant: tempest-AttachVolumeTestJSON-1798153056 Jul 12 14:47:00.887922 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Id: 52569bf4eba24c2a9fa0ef8c26b8b22d Jul 12 14:47:00.887922 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1798153056 Jul 12 14:47:00.887922 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User: tempest-AttachVolumeTestJSON-1798153056-project Jul 12 14:47:00.887922 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Id: default Jul 12 14:47:00.887922 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Name: Default Jul 12 14:47:00.887922 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Id: 8f118c0ba8494e6e9f5a4488ebf8d220 Jul 12 14:47:00.887922 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Name: tempest-AttachVolumeTestJSON-1798153056-project Jul 12 14:47:00.887922 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: method: > Jul 12 14:47:00.887922 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: exception: Instance 059eea39-a5fd-4428-8c51-5548bc8b0e15 could not be found. Jul 12 14:47:00.887922 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: action_args: {'id': '059eea39-a5fd-4428-8c51-5548bc8b0e15'} Jul 12 14:47:00.889327 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:47:00.889327 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:00.889327 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:47:00.889327 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:47:00.889327 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:47:00.889327 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:47:00.889327 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:47:00.889327 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:47:00.889327 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:47:00.889327 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:47:00.889327 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 059eea39-a5fd-4428-8c51-5548bc8b0e15 could not be found. Jul 12 14:47:00.889327 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:47:00.889327 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:47:00.889327 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:47:00.889327 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:00.889327 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:47:00.889327 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:47:00.889327 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:47:00.889327 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:47:00.889327 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:47:00.891484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:47:00.891484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:47:00.891484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:47:00.891484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:47:00.891484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:47:00.891484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:47:00.891484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:47:00.891484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 059eea39-a5fd-4428-8c51-5548bc8b0e15 could not be found. Jul 12 14:47:00.891484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:47:00.891484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:47:00.891484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:47:00.891484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:00.891484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:47:00.891484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:47:00.891484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:47:00.891484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:47:00.891484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 059eea39-a5fd-4428-8c51-5548bc8b0e15 could not be found. Jul 12 14:47:00.891484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:47:00.892851 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-d2ee078b-10d9-42a5-95ba-6c5bea849799 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Returning 404 to user: Instance 059eea39-a5fd-4428-8c51-5548bc8b0e15 could not be found. {{(pid=129980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:47:00.892851 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-d2ee078b-10d9-42a5-95ba-6c5bea849799 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15" status: 404 len: 111 microversion: 2.1 time: 0.031377 Jul 12 14:47:00.892851 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 453/907] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:00 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:47:00.898021 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-b968e2c9-dca0-48b7-8319-4bbc4253df79 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '.version_select at 0x7f962c80c700>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:00.987288 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-b968e2c9-dca0-48b7-8319-4bbc4253df79 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1012504499" status: 202 len: 0 microversion: 2.1 time: 0.092978 Jul 12 14:47:00.987879 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 455/908] 10.222.0.30 () {58 vars in 1220 bytes} [Tue Jul 12 14:47:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1012504499 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:47:01.868462 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-1c26a91b-d06d-45e7-9fce-b0f50f8bd1dc tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:01.869034 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-1c26a91b-d06d-45e7-9fce-b0f50f8bd1dc tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:01.875943 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1c26a91b-d06d-45e7-9fce-b0f50f8bd1dc tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:01.876394 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1c26a91b-d06d-45e7-9fce-b0f50f8bd1dc tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:01.877602 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1c26a91b-d06d-45e7-9fce-b0f50f8bd1dc tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:01.877871 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1c26a91b-d06d-45e7-9fce-b0f50f8bd1dc tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:02.162916 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-1c26a91b-d06d-45e7-9fce-b0f50f8bd1dc tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:02.170348 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-1c26a91b-d06d-45e7-9fce-b0f50f8bd1dc tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 200 len: 1264 microversion: 2.1 time: 0.306138 Jul 12 14:47:02.170907 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 454/909] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:01 2022] GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 1264 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:03.187577 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-dfb666c0-61f5-4d22-ade3-9a8ca30f8ba6 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:03.187967 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-dfb666c0-61f5-4d22-ade3-9a8ca30f8ba6 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:03.194691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-dfb666c0-61f5-4d22-ade3-9a8ca30f8ba6 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:03.195302 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-dfb666c0-61f5-4d22-ade3-9a8ca30f8ba6 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:03.202122 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-dfb666c0-61f5-4d22-ade3-9a8ca30f8ba6 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:03.202567 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-dfb666c0-61f5-4d22-ade3-9a8ca30f8ba6 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:03.332377 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-dfb666c0-61f5-4d22-ade3-9a8ca30f8ba6 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:03.339923 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-dfb666c0-61f5-4d22-ade3-9a8ca30f8ba6 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 200 len: 1264 microversion: 2.1 time: 0.157096 Jul 12 14:47:03.340491 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 456/910] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:03 2022] GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:04.355830 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-6e976aa1-84aa-4aa2-a659-fe0aaf74125c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:04.356397 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-6e976aa1-84aa-4aa2-a659-fe0aaf74125c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:04.362872 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6e976aa1-84aa-4aa2-a659-fe0aaf74125c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:04.363334 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6e976aa1-84aa-4aa2-a659-fe0aaf74125c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:04.364096 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6e976aa1-84aa-4aa2-a659-fe0aaf74125c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:04.364580 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6e976aa1-84aa-4aa2-a659-fe0aaf74125c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:04.493667 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-6e976aa1-84aa-4aa2-a659-fe0aaf74125c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:04.501017 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-6e976aa1-84aa-4aa2-a659-fe0aaf74125c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 200 len: 1264 microversion: 2.1 time: 0.149204 Jul 12 14:47:04.501600 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 455/911] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:04 2022] GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:05.517666 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-975958b9-584d-4d24-8774-0bc0caae6b21 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:05.518279 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-975958b9-584d-4d24-8774-0bc0caae6b21 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:05.524766 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-975958b9-584d-4d24-8774-0bc0caae6b21 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:05.525244 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-975958b9-584d-4d24-8774-0bc0caae6b21 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:05.526013 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-975958b9-584d-4d24-8774-0bc0caae6b21 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:05.526452 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-975958b9-584d-4d24-8774-0bc0caae6b21 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:05.663226 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-975958b9-584d-4d24-8774-0bc0caae6b21 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:05.670913 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-975958b9-584d-4d24-8774-0bc0caae6b21 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 200 len: 1451 microversion: 2.1 time: 0.157173 Jul 12 14:47:05.671471 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 457/912] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:05 2022] GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:05.687192 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-434187e2-7e1c-4b1f-bc09-dd51529db9d5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:05.687822 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-434187e2-7e1c-4b1f-bc09-dd51529db9d5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:05.694589 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-434187e2-7e1c-4b1f-bc09-dd51529db9d5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:05.695657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-434187e2-7e1c-4b1f-bc09-dd51529db9d5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:05.696418 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-434187e2-7e1c-4b1f-bc09-dd51529db9d5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:05.696852 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-434187e2-7e1c-4b1f-bc09-dd51529db9d5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:05.827848 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-434187e2-7e1c-4b1f-bc09-dd51529db9d5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:05.835768 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-434187e2-7e1c-4b1f-bc09-dd51529db9d5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 200 len: 1451 microversion: 2.1 time: 0.152239 Jul 12 14:47:05.836335 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 456/913] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:05 2022] GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:06.446178 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-42119f50-48cb-4416-8ace-a2ad4e09b26a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:06.446677 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-42119f50-48cb-4416-8ace-a2ad4e09b26a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:06.452869 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-42119f50-48cb-4416-8ace-a2ad4e09b26a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:06.453356 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-42119f50-48cb-4416-8ace-a2ad4e09b26a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:06.454160 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-42119f50-48cb-4416-8ace-a2ad4e09b26a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:06.454608 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-42119f50-48cb-4416-8ace-a2ad4e09b26a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:06.468463 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.wsgi [None req-42119f50-48cb-4416-8ace-a2ad4e09b26a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] HTTP exception thrown: Instance 059eea39-a5fd-4428-8c51-5548bc8b0e15 could not be found. Jul 12 14:47:06.470188 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-42119f50-48cb-4416-8ace-a2ad4e09b26a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Request method failure captured: Jul 12 14:47:06.470188 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: DELETE /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 HTTP/1.1 Jul 12 14:47:06.470188 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:47:06.470188 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:47:06.470188 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:47:06.470188 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 0 Jul 12 14:47:06.470188 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:47:06.470188 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:47:06.470188 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:47:06.470188 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:47:06.470188 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYefRPL1Y5GiliCzIK08041f1Xxv1Ly2Io92QPGJA-es3aoqpvK1tGkAqQB5fyoYZ3ClU870S111187SuwpRMPJRyhk3AsIKs4BN17uqZUvFCQEi7vdAzPhV4xJpo7kqnPIrySsHTNx3xSjU6VY6elQK0bX17gwzq2pB_ccF3Vb95iQ Jul 12 14:47:06.470188 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:47:06.470188 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:47:06.470188 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:47:06.470188 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:47:06.470188 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:47:06.470188 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:47:06.470188 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: 52569bf4eba24c2a9fa0ef8c26b8b22d Jul 12 14:47:06.470188 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-AttachVolumeTestJSON-1798153056 Jul 12 14:47:06.470188 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:47:06.470188 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:47:06.471780 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/52569bf4eba24c2a9fa0ef8c26b8b22d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/52569bf4eba24c2a9fa0ef8c26b8b22d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/52569bf4eba24c2a9fa0ef8c26b8b22d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_52569bf4eba24c2a9fa0ef8c26b8b22d", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:47:06.471780 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-AttachVolumeTestJSON-1798153056 Jul 12 14:47:06.471780 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: 52569bf4eba24c2a9fa0ef8c26b8b22d Jul 12 14:47:06.471780 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1798153056 Jul 12 14:47:06.471780 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-AttachVolumeTestJSON-1798153056-project Jul 12 14:47:06.471780 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:47:06.471780 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:47:06.471780 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: 8f118c0ba8494e6e9f5a4488ebf8d220 Jul 12 14:47:06.471780 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-AttachVolumeTestJSON-1798153056-project Jul 12 14:47:06.471780 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: > Jul 12 14:47:06.471780 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Instance 059eea39-a5fd-4428-8c51-5548bc8b0e15 could not be found. Jul 12 14:47:06.471780 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'id': '059eea39-a5fd-4428-8c51-5548bc8b0e15'} Jul 12 14:47:06.474547 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:47:06.474547 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:06.474547 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:47:06.474547 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:47:06.474547 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:47:06.474547 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:47:06.474547 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:47:06.474547 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:47:06.474547 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:47:06.474547 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:47:06.474547 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 059eea39-a5fd-4428-8c51-5548bc8b0e15 could not be found. Jul 12 14:47:06.474547 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:47:06.474547 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:47:06.474547 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:47:06.474547 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:06.474547 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:47:06.474547 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:47:06.474547 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:47:06.474547 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:47:06.474547 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:47:06.476626 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:47:06.476626 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 14:47:06.476626 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 14:47:06.476626 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 14:47:06.476626 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 14:47:06.476626 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:47:06.476626 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:47:06.476626 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:47:06.476626 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:47:06.476626 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 059eea39-a5fd-4428-8c51-5548bc8b0e15 could not be found. Jul 12 14:47:06.476626 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:47:06.476626 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:47:06.476626 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:47:06.476626 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:06.476626 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:47:06.476626 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:47:06.476626 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:47:06.476626 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:47:06.476626 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 059eea39-a5fd-4428-8c51-5548bc8b0e15 could not be found. Jul 12 14:47:06.476626 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:47:06.478136 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-42119f50-48cb-4416-8ace-a2ad4e09b26a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Returning 404 to user: Instance 059eea39-a5fd-4428-8c51-5548bc8b0e15 could not be found. {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:47:06.478136 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-42119f50-48cb-4416-8ace-a2ad4e09b26a tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "DELETE /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15" status: 404 len: 111 microversion: 2.1 time: 0.029458 Jul 12 14:47:06.478136 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 458/914] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Jul 12 14:47:06 2022] DELETE /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:47:06.480684 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-c8b55e39-956f-4fa4-8198-fa33eb34c2ac tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:06.481350 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-c8b55e39-956f-4fa4-8198-fa33eb34c2ac tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: 059eea39-a5fd-4428-8c51-5548bc8b0e15] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:06.487923 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c8b55e39-956f-4fa4-8198-fa33eb34c2ac tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:06.487923 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c8b55e39-956f-4fa4-8198-fa33eb34c2ac tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:06.488545 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c8b55e39-956f-4fa4-8198-fa33eb34c2ac tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:06.488994 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c8b55e39-956f-4fa4-8198-fa33eb34c2ac tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:06.502215 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.wsgi [None req-c8b55e39-956f-4fa4-8198-fa33eb34c2ac tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] HTTP exception thrown: Instance 059eea39-a5fd-4428-8c51-5548bc8b0e15 could not be found. Jul 12 14:47:06.504003 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-c8b55e39-956f-4fa4-8198-fa33eb34c2ac tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Request method failure captured: Jul 12 14:47:06.504003 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: request: GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 HTTP/1.1 Jul 12 14:47:06.504003 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept: application/json Jul 12 14:47:06.504003 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept-Encoding: identity Jul 12 14:47:06.504003 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Connection: close Jul 12 14:47:06.504003 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Length: 0 Jul 12 14:47:06.504003 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Type: application/json Jul 12 14:47:06.504003 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Host: 10.222.0.30 Jul 12 14:47:06.504003 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Openstack-System-Scope: None Jul 12 14:47:06.504003 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: User-Agent: python-urllib3/1.26.9 Jul 12 14:47:06.504003 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Auth-Token: gAAAAABizYefRPL1Y5GiliCzIK08041f1Xxv1Ly2Io92QPGJA-es3aoqpvK1tGkAqQB5fyoYZ3ClU870S111187SuwpRMPJRyhk3AsIKs4BN17uqZUvFCQEi7vdAzPhV4xJpo7kqnPIrySsHTNx3xSjU6VY6elQK0bX17gwzq2pB_ccF3Vb95iQ Jul 12 14:47:06.504003 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Id: None Jul 12 14:47:06.504003 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Name: None Jul 12 14:47:06.504003 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Identity-Status: Confirmed Jul 12 14:47:06.504003 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Is-Admin-Project: True Jul 12 14:47:06.504003 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Id: default Jul 12 14:47:06.504003 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Name: Default Jul 12 14:47:06.504003 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Id: 52569bf4eba24c2a9fa0ef8c26b8b22d Jul 12 14:47:06.504003 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Name: tempest-AttachVolumeTestJSON-1798153056 Jul 12 14:47:06.504003 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Role: member,reader Jul 12 14:47:06.504003 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Roles: member,reader Jul 12 14:47:06.505750 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/52569bf4eba24c2a9fa0ef8c26b8b22d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/52569bf4eba24c2a9fa0ef8c26b8b22d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/52569bf4eba24c2a9fa0ef8c26b8b22d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_52569bf4eba24c2a9fa0ef8c26b8b22d", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:47:06.505750 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant: tempest-AttachVolumeTestJSON-1798153056 Jul 12 14:47:06.505750 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Id: 52569bf4eba24c2a9fa0ef8c26b8b22d Jul 12 14:47:06.505750 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1798153056 Jul 12 14:47:06.505750 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User: tempest-AttachVolumeTestJSON-1798153056-project Jul 12 14:47:06.505750 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Id: default Jul 12 14:47:06.505750 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Name: Default Jul 12 14:47:06.505750 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Id: 8f118c0ba8494e6e9f5a4488ebf8d220 Jul 12 14:47:06.505750 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Name: tempest-AttachVolumeTestJSON-1798153056-project Jul 12 14:47:06.505750 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: method: > Jul 12 14:47:06.505750 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: exception: Instance 059eea39-a5fd-4428-8c51-5548bc8b0e15 could not be found. Jul 12 14:47:06.505750 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: action_args: {'id': '059eea39-a5fd-4428-8c51-5548bc8b0e15'} Jul 12 14:47:06.506531 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:47:06.506531 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:06.506531 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:47:06.506531 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:47:06.506531 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:47:06.506531 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:47:06.506531 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:47:06.506531 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:47:06.506531 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:47:06.506531 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:47:06.506531 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 059eea39-a5fd-4428-8c51-5548bc8b0e15 could not be found. Jul 12 14:47:06.506531 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:47:06.506531 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:47:06.506531 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:47:06.506531 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:06.506531 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:47:06.506531 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:47:06.506531 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:47:06.506531 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:47:06.506531 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:47:06.508367 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:47:06.508367 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:47:06.508367 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:47:06.508367 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:47:06.508367 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:47:06.508367 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:47:06.508367 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:47:06.508367 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 059eea39-a5fd-4428-8c51-5548bc8b0e15 could not be found. Jul 12 14:47:06.508367 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:47:06.508367 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:47:06.508367 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:47:06.508367 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:06.508367 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:47:06.508367 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:47:06.508367 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:47:06.508367 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:47:06.508367 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 059eea39-a5fd-4428-8c51-5548bc8b0e15 could not be found. Jul 12 14:47:06.508367 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:47:06.514473 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-c8b55e39-956f-4fa4-8198-fa33eb34c2ac tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Returning 404 to user: Instance 059eea39-a5fd-4428-8c51-5548bc8b0e15 could not be found. {{(pid=129980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:47:06.514473 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-c8b55e39-956f-4fa4-8198-fa33eb34c2ac tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15" status: 404 len: 111 microversion: 2.1 time: 0.029165 Jul 12 14:47:06.514473 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 457/915] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:06 2022] GET /compute/v2.1/servers/059eea39-a5fd-4428-8c51-5548bc8b0e15 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:47:07.821464 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-804b96c9-73f5-4327-bba2-53da41057cf4 req-5a148b6f-5627-4bb8-b2d0-99cc82821cfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48873689-94c9-4887-9b4b-7eca17ddd173", "tag": "561b44eb-0d73-4072-bb0f-14b66c4fd904"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:47:07.833544 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-804b96c9-73f5-4327-bba2-53da41057cf4 req-5a148b6f-5627-4bb8-b2d0-99cc82821cfe service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:07.834308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-804b96c9-73f5-4327-bba2-53da41057cf4 req-5a148b6f-5627-4bb8-b2d0-99cc82821cfe service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:07.838777 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-4794ac2f-83f9-4e30-a186-ec0e3e6e57d8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:07.839850 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-4794ac2f-83f9-4e30-a186-ec0e3e6e57d8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:07.846847 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4794ac2f-83f9-4e30-a186-ec0e3e6e57d8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:07.847581 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4794ac2f-83f9-4e30-a186-ec0e3e6e57d8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:07.848556 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4794ac2f-83f9-4e30-a186-ec0e3e6e57d8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:07.848989 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4794ac2f-83f9-4e30-a186-ec0e3e6e57d8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:07.849837 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-804b96c9-73f5-4327-bba2-53da41057cf4 req-5a148b6f-5627-4bb8-b2d0-99cc82821cfe service nova] Creating event network-changed:561b44eb-0d73-4072-bb0f-14b66c4fd904 for instance 48873689-94c9-4887-9b4b-7eca17ddd173 on hv-cinder-82002 Jul 12 14:47:07.856322 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-804b96c9-73f5-4327-bba2-53da41057cf4 req-5a148b6f-5627-4bb8-b2d0-99cc82821cfe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038412 Jul 12 14:47:07.859834 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 459/916] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:47:07.864334 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.wsgi [None req-4794ac2f-83f9-4e30-a186-ec0e3e6e57d8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] HTTP exception thrown: Instance b8f59b92-aa7f-496d-a19c-9035a4948560 could not be found. Jul 12 14:47:07.865998 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-4794ac2f-83f9-4e30-a186-ec0e3e6e57d8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Request method failure captured: Jul 12 14:47:07.865998 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: request: DELETE /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 HTTP/1.1 Jul 12 14:47:07.865998 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept: application/json Jul 12 14:47:07.865998 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept-Encoding: identity Jul 12 14:47:07.865998 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Connection: close Jul 12 14:47:07.865998 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Length: 0 Jul 12 14:47:07.865998 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Type: application/json Jul 12 14:47:07.865998 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Host: 10.222.0.30 Jul 12 14:47:07.865998 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Openstack-System-Scope: None Jul 12 14:47:07.865998 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: User-Agent: python-urllib3/1.26.9 Jul 12 14:47:07.865998 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Auth-Token: gAAAAABizYefRPL1Y5GiliCzIK08041f1Xxv1Ly2Io92QPGJA-es3aoqpvK1tGkAqQB5fyoYZ3ClU870S111187SuwpRMPJRyhk3AsIKs4BN17uqZUvFCQEi7vdAzPhV4xJpo7kqnPIrySsHTNx3xSjU6VY6elQK0bX17gwzq2pB_ccF3Vb95iQ Jul 12 14:47:07.865998 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Id: None Jul 12 14:47:07.865998 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Name: None Jul 12 14:47:07.865998 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Identity-Status: Confirmed Jul 12 14:47:07.865998 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Is-Admin-Project: True Jul 12 14:47:07.865998 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Id: default Jul 12 14:47:07.865998 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Name: Default Jul 12 14:47:07.865998 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Id: 52569bf4eba24c2a9fa0ef8c26b8b22d Jul 12 14:47:07.865998 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Name: tempest-AttachVolumeTestJSON-1798153056 Jul 12 14:47:07.865998 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Role: member,reader Jul 12 14:47:07.865998 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Roles: member,reader Jul 12 14:47:07.867719 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/52569bf4eba24c2a9fa0ef8c26b8b22d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/52569bf4eba24c2a9fa0ef8c26b8b22d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/52569bf4eba24c2a9fa0ef8c26b8b22d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_52569bf4eba24c2a9fa0ef8c26b8b22d", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:47:07.867719 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant: tempest-AttachVolumeTestJSON-1798153056 Jul 12 14:47:07.867719 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Id: 52569bf4eba24c2a9fa0ef8c26b8b22d Jul 12 14:47:07.867719 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1798153056 Jul 12 14:47:07.867719 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User: tempest-AttachVolumeTestJSON-1798153056-project Jul 12 14:47:07.867719 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Id: default Jul 12 14:47:07.867719 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Name: Default Jul 12 14:47:07.867719 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Id: 8f118c0ba8494e6e9f5a4488ebf8d220 Jul 12 14:47:07.867719 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Name: tempest-AttachVolumeTestJSON-1798153056-project Jul 12 14:47:07.867719 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: method: > Jul 12 14:47:07.867719 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: exception: Instance b8f59b92-aa7f-496d-a19c-9035a4948560 could not be found. Jul 12 14:47:07.867719 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: action_args: {'id': 'b8f59b92-aa7f-496d-a19c-9035a4948560'} Jul 12 14:47:07.868558 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:47:07.868558 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:07.868558 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:47:07.868558 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:47:07.868558 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:47:07.868558 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:47:07.868558 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:47:07.868558 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:47:07.868558 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:47:07.868558 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:47:07.868558 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8f59b92-aa7f-496d-a19c-9035a4948560 could not be found. Jul 12 14:47:07.868558 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:47:07.868558 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:47:07.868558 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:47:07.868558 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:07.868558 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:47:07.868558 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:47:07.868558 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:47:07.868558 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:47:07.868558 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:47:07.870183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:47:07.870183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 14:47:07.870183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 14:47:07.870183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 14:47:07.870183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 14:47:07.870183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:47:07.870183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:47:07.870183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:47:07.870183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:47:07.870183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8f59b92-aa7f-496d-a19c-9035a4948560 could not be found. Jul 12 14:47:07.870183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:47:07.870183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:47:07.870183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:47:07.870183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:07.870183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:47:07.870183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:47:07.870183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:47:07.870183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:47:07.870183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8f59b92-aa7f-496d-a19c-9035a4948560 could not be found. Jul 12 14:47:07.870183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:47:07.871636 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-4794ac2f-83f9-4e30-a186-ec0e3e6e57d8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Returning 404 to user: Instance b8f59b92-aa7f-496d-a19c-9035a4948560 could not be found. {{(pid=129980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:47:07.871636 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-4794ac2f-83f9-4e30-a186-ec0e3e6e57d8 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 404 len: 111 microversion: 2.1 time: 0.033220 Jul 12 14:47:07.871636 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 458/917] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Jul 12 14:47:07 2022] DELETE /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:47:07.878425 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-f604e114-df5e-48e5-8a48-00d0abe5d309 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:07.880596 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-f604e114-df5e-48e5-8a48-00d0abe5d309 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] [instance: b8f59b92-aa7f-496d-a19c-9035a4948560] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:07.886408 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f604e114-df5e-48e5-8a48-00d0abe5d309 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:07.887210 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f604e114-df5e-48e5-8a48-00d0abe5d309 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:07.887994 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f604e114-df5e-48e5-8a48-00d0abe5d309 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:07.888506 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f604e114-df5e-48e5-8a48-00d0abe5d309 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:07.905950 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.wsgi [None req-f604e114-df5e-48e5-8a48-00d0abe5d309 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] HTTP exception thrown: Instance b8f59b92-aa7f-496d-a19c-9035a4948560 could not be found. Jul 12 14:47:07.909278 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-f604e114-df5e-48e5-8a48-00d0abe5d309 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Request method failure captured: Jul 12 14:47:07.909278 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 HTTP/1.1 Jul 12 14:47:07.909278 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:47:07.909278 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:47:07.909278 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:47:07.909278 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 0 Jul 12 14:47:07.909278 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:47:07.909278 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:47:07.909278 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:47:07.909278 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:47:07.909278 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYefRPL1Y5GiliCzIK08041f1Xxv1Ly2Io92QPGJA-es3aoqpvK1tGkAqQB5fyoYZ3ClU870S111187SuwpRMPJRyhk3AsIKs4BN17uqZUvFCQEi7vdAzPhV4xJpo7kqnPIrySsHTNx3xSjU6VY6elQK0bX17gwzq2pB_ccF3Vb95iQ Jul 12 14:47:07.909278 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:47:07.909278 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:47:07.909278 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:47:07.909278 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:47:07.909278 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:47:07.909278 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:47:07.909278 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: 52569bf4eba24c2a9fa0ef8c26b8b22d Jul 12 14:47:07.909278 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-AttachVolumeTestJSON-1798153056 Jul 12 14:47:07.909278 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:47:07.909278 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:47:07.910746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/52569bf4eba24c2a9fa0ef8c26b8b22d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/52569bf4eba24c2a9fa0ef8c26b8b22d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/52569bf4eba24c2a9fa0ef8c26b8b22d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_52569bf4eba24c2a9fa0ef8c26b8b22d", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:47:07.910746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-AttachVolumeTestJSON-1798153056 Jul 12 14:47:07.910746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: 52569bf4eba24c2a9fa0ef8c26b8b22d Jul 12 14:47:07.910746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1798153056 Jul 12 14:47:07.910746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-AttachVolumeTestJSON-1798153056-project Jul 12 14:47:07.910746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:47:07.910746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:47:07.910746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: 8f118c0ba8494e6e9f5a4488ebf8d220 Jul 12 14:47:07.910746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-AttachVolumeTestJSON-1798153056-project Jul 12 14:47:07.910746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: > Jul 12 14:47:07.910746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Instance b8f59b92-aa7f-496d-a19c-9035a4948560 could not be found. Jul 12 14:47:07.910746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'id': 'b8f59b92-aa7f-496d-a19c-9035a4948560'} Jul 12 14:47:07.911544 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:47:07.911544 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:07.911544 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:47:07.911544 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:47:07.911544 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:47:07.911544 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:47:07.911544 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:47:07.911544 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:47:07.911544 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:47:07.911544 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:47:07.911544 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8f59b92-aa7f-496d-a19c-9035a4948560 could not be found. Jul 12 14:47:07.911544 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:47:07.911544 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:47:07.911544 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:47:07.911544 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:07.911544 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:47:07.911544 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:47:07.911544 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:47:07.911544 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:47:07.911544 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:47:07.912862 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:47:07.912862 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:47:07.912862 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:47:07.912862 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:47:07.912862 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:47:07.912862 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:47:07.912862 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:47:07.912862 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8f59b92-aa7f-496d-a19c-9035a4948560 could not be found. Jul 12 14:47:07.912862 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:47:07.912862 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:47:07.912862 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:47:07.912862 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:07.912862 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:47:07.912862 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:47:07.912862 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:47:07.912862 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:47:07.912862 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8f59b92-aa7f-496d-a19c-9035a4948560 could not be found. Jul 12 14:47:07.912862 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:47:07.914813 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-f604e114-df5e-48e5-8a48-00d0abe5d309 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] Returning 404 to user: Instance b8f59b92-aa7f-496d-a19c-9035a4948560 could not be found. {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:47:07.914813 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-f604e114-df5e-48e5-8a48-00d0abe5d309 tempest-AttachVolumeTestJSON-1798153056 tempest-AttachVolumeTestJSON-1798153056-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560" status: 404 len: 111 microversion: 2.1 time: 0.035658 Jul 12 14:47:07.914813 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 460/918] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:07 2022] GET /compute/v2.1/servers/b8f59b92-aa7f-496d-a19c-9035a4948560 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:47:16.584441 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-fc6cfdb6-5695-46cf-bd73-7b8a866bf88f tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1210717003", "imageRef": "a66ccacb-7b1e-4f51-9eaf-069a356e0fdb", "flavorRef": "452", "networks": [{"uuid": "42dafc72-b3d0-4625-899c-fa87da784304"}]}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:47:16.639911 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.network.neutron [None req-fc6cfdb6-5695-46cf-bd73-7b8a866bf88f tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] validate_networks() for [('42dafc72-b3d0-4625-899c-fa87da784304', None, None, None, None, None)] {{(pid=129980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:47:17.019364 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-fc6cfdb6-5695-46cf-bd73-7b8a866bf88f tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Flavor limits 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:47:17.019796 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-fc6cfdb6-5695-46cf-bd73-7b8a866bf88f tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Image limits 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:47:17.020275 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-fc6cfdb6-5695-46cf-bd73-7b8a866bf88f tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Flavor pref 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:47:17.020690 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-fc6cfdb6-5695-46cf-bd73-7b8a866bf88f tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Image pref 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:47:17.031693 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-fc6cfdb6-5695-46cf-bd73-7b8a866bf88f tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:47:17.031693 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fc6cfdb6-5695-46cf-bd73-7b8a866bf88f tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:17.031693 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fc6cfdb6-5695-46cf-bd73-7b8a866bf88f tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:17.032409 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fc6cfdb6-5695-46cf-bd73-7b8a866bf88f tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:17.032517 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fc6cfdb6-5695-46cf-bd73-7b8a866bf88f tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:17.050431 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-fc6cfdb6-5695-46cf-bd73-7b8a866bf88f tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Getting quotas for project e89c4c765f5243eaa314231429d20598. Resources: {'instances', 'cores', 'ram'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:47:17.054642 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-fc6cfdb6-5695-46cf-bd73-7b8a866bf88f tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Getting quotas for user 2b123a78349c4daba0502a4e9e98245f and project e89c4c765f5243eaa314231429d20598. Resources: {'instances', 'cores', 'ram'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:47:17.066573 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-fc6cfdb6-5695-46cf-bd73-7b8a866bf88f tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Going to run 1 instances... {{(pid=129980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:47:17.068854 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-fc6cfdb6-5695-46cf-bd73-7b8a866bf88f tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 042348db-3a7f-47c5-8d26-336846b56bf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a66ccacb-7b1e-4f51-9eaf-069a356e0fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:47:17.272584 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-fc6cfdb6-5695-46cf-bd73-7b8a866bf88f tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691923 Jul 12 14:47:17.273996 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 459/919] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Jul 12 14:47:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:47:17.284281 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-94acb0bb-626f-4ba2-9c3d-b73c8e9a4b2e tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:17.284882 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-94acb0bb-626f-4ba2-9c3d-b73c8e9a4b2e tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 042348db-3a7f-47c5-8d26-336846b56bf1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:17.289122 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:47:17.375832 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-94acb0bb-626f-4ba2-9c3d-b73c8e9a4b2e tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:17.386432 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-94acb0bb-626f-4ba2-9c3d-b73c8e9a4b2e tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1" status: 200 len: 1219 microversion: 2.1 time: 0.105849 Jul 12 14:47:17.389842 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 461/920] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:17 2022] GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1 => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:18.408005 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-f5de2904-d285-4aba-b489-9d92d4548186 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:18.412320 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-f5de2904-d285-4aba-b489-9d92d4548186 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 042348db-3a7f-47c5-8d26-336846b56bf1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:18.474523 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-f5de2904-d285-4aba-b489-9d92d4548186 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:18.482359 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-f5de2904-d285-4aba-b489-9d92d4548186 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1" status: 200 len: 1219 microversion: 2.1 time: 0.079107 Jul 12 14:47:18.483135 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 460/921] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:18 2022] GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:47:19.500065 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-3e121368-a594-49cf-8b59-a474ff4f0cf4 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:19.501569 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-3e121368-a594-49cf-8b59-a474ff4f0cf4 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 042348db-3a7f-47c5-8d26-336846b56bf1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:19.512566 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=68 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:47:19.517882 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3e121368-a594-49cf-8b59-a474ff4f0cf4 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:19.518340 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3e121368-a594-49cf-8b59-a474ff4f0cf4 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:19.520804 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3e121368-a594-49cf-8b59-a474ff4f0cf4 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:19.521285 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3e121368-a594-49cf-8b59-a474ff4f0cf4 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:19.630899 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-3e121368-a594-49cf-8b59-a474ff4f0cf4 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:19.647258 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-3e121368-a594-49cf-8b59-a474ff4f0cf4 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1" status: 200 len: 1271 microversion: 2.1 time: 0.151468 Jul 12 14:47:19.652253 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 462/922] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:19 2022] GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1 => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:19.994442 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-1ecc350e-0e32-4d60-bf2a-3f74256705b7 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Action: 'create', calling method: .version_select at 0x7f963129d430>, body: {"keypair": {"name": "tempest-keypair-821938727", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSokE+d9ZFWjCe+F/AuEcMz/k7nMFW3sHsVgnsa83ef1nDOffOMOOuZV3XSkFaExbxl+SJRkUEO5vz4er1jLuWd+IcXdAU+tI37rUXKv3PPlWusbH2eJJ7dnMmYf/BZaA=="}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:47:20.009216 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-1ecc350e-0e32-4d60-bf2a-3f74256705b7 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Getting quotas for project 35438fec2e37438e99201870e0d650af. Resources: {'key_pairs'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:47:20.013297 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-1ecc350e-0e32-4d60-bf2a-3f74256705b7 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Getting quotas for user f926d674e2dc4eb58d7fe6379b79310b and project 35438fec2e37438e99201870e0d650af. Resources: {'key_pairs'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:47:20.085489 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-1ecc350e-0e32-4d60-bf2a-3f74256705b7 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.298271 Jul 12 14:47:20.086674 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 461/923] 10.222.0.30 () {60 vars in 1158 bytes} [Tue Jul 12 14:47:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:47:20.666307 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-aad54a2f-0d5e-4e6f-9cf3-3fe7072cc6be tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:20.666980 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-aad54a2f-0d5e-4e6f-9cf3-3fe7072cc6be tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 042348db-3a7f-47c5-8d26-336846b56bf1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:20.674370 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-aad54a2f-0d5e-4e6f-9cf3-3fe7072cc6be tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:20.675241 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-aad54a2f-0d5e-4e6f-9cf3-3fe7072cc6be tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:20.676279 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-aad54a2f-0d5e-4e6f-9cf3-3fe7072cc6be tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:20.676790 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-aad54a2f-0d5e-4e6f-9cf3-3fe7072cc6be tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:20.906092 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-aad54a2f-0d5e-4e6f-9cf3-3fe7072cc6be tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:20.915090 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-aad54a2f-0d5e-4e6f-9cf3-3fe7072cc6be tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1" status: 200 len: 1319 microversion: 2.1 time: 0.254309 Jul 12 14:47:20.915905 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 463/924] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:20 2022] GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:20.955295 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-d34cfdcd-23bd-4889-9341-d053fa03e737 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:20.955295 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-d34cfdcd-23bd-4889-9341-d053fa03e737 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:20.960895 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d34cfdcd-23bd-4889-9341-d053fa03e737 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:20.961474 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d34cfdcd-23bd-4889-9341-d053fa03e737 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:20.962268 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d34cfdcd-23bd-4889-9341-d053fa03e737 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:20.962712 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d34cfdcd-23bd-4889-9341-d053fa03e737 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:20.994625 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-d34cfdcd-23bd-4889-9341-d053fa03e737 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047668 Jul 12 14:47:20.995359 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 462/925] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Jul 12 14:47:20 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:21.054029 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e74264e7-8e71-420e-bac3-9e8ab57e1e54 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:21.055044 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-e74264e7-8e71-420e-bac3-9e8ab57e1e54 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:21.064891 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e74264e7-8e71-420e-bac3-9e8ab57e1e54 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:21.077488 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e74264e7-8e71-420e-bac3-9e8ab57e1e54 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:21.078771 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e74264e7-8e71-420e-bac3-9e8ab57e1e54 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:21.079468 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e74264e7-8e71-420e-bac3-9e8ab57e1e54 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:21.118058 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-e74264e7-8e71-420e-bac3-9e8ab57e1e54 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Going to try to terminate instance {{(pid=129981) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:47:21.427611 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-e74264e7-8e71-420e-bac3-9e8ab57e1e54 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "DELETE /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 204 len: 0 microversion: 2.20 time: 0.377092 Jul 12 14:47:21.428404 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 464/926] 10.222.0.30 () {60 vars in 1279 bytes} [Tue Jul 12 14:47:21 2022] DELETE /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 14:47:21.438107 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-49dc1aaf-fae9-40ec-9d15-561085902093 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:21.439080 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-49dc1aaf-fae9-40ec-9d15-561085902093 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:21.447912 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-49dc1aaf-fae9-40ec-9d15-561085902093 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:21.448927 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-49dc1aaf-fae9-40ec-9d15-561085902093 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:21.449911 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-49dc1aaf-fae9-40ec-9d15-561085902093 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:21.450458 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-49dc1aaf-fae9-40ec-9d15-561085902093 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:21.650905 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-49dc1aaf-fae9-40ec-9d15-561085902093 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:21.660840 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-49dc1aaf-fae9-40ec-9d15-561085902093 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:21.673500 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-49dc1aaf-fae9-40ec-9d15-561085902093 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:21.677791 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-49dc1aaf-fae9-40ec-9d15-561085902093 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1722 microversion: 2.20 time: 0.244217 Jul 12 14:47:21.686675 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 463/927] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:47:21 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:47:21.935394 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-62f84b16-6a34-4f8d-8536-616e86776d7a tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:21.936209 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-62f84b16-6a34-4f8d-8536-616e86776d7a tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 042348db-3a7f-47c5-8d26-336846b56bf1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:21.950463 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-62f84b16-6a34-4f8d-8536-616e86776d7a tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:21.953342 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-62f84b16-6a34-4f8d-8536-616e86776d7a tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:21.957132 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-62f84b16-6a34-4f8d-8536-616e86776d7a tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:21.957780 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-62f84b16-6a34-4f8d-8536-616e86776d7a tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:22.012203 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-f78dfabb-93ce-4eed-b725-ff6e86bdb746 req-56ac874a-da5e-4d6f-9db4-ad29e5e38004 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "042348db-3a7f-47c5-8d26-336846b56bf1", "tag": "fefcfef8-6a7e-4939-8324-f3f2f622a338"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:47:22.031344 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-f78dfabb-93ce-4eed-b725-ff6e86bdb746 req-56ac874a-da5e-4d6f-9db4-ad29e5e38004 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:22.031825 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-f78dfabb-93ce-4eed-b725-ff6e86bdb746 req-56ac874a-da5e-4d6f-9db4-ad29e5e38004 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:22.058256 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-f78dfabb-93ce-4eed-b725-ff6e86bdb746 req-56ac874a-da5e-4d6f-9db4-ad29e5e38004 service nova] Creating event network-changed:fefcfef8-6a7e-4939-8324-f3f2f622a338 for instance 042348db-3a7f-47c5-8d26-336846b56bf1 on hv-cinder-82002 Jul 12 14:47:22.071194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-f78dfabb-93ce-4eed-b725-ff6e86bdb746 req-56ac874a-da5e-4d6f-9db4-ad29e5e38004 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067998 Jul 12 14:47:22.073545 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 464/928] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:47:22.165441 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-62f84b16-6a34-4f8d-8536-616e86776d7a tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:22.174641 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-62f84b16-6a34-4f8d-8536-616e86776d7a tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1" status: 200 len: 1319 microversion: 2.1 time: 0.243537 Jul 12 14:47:22.184877 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 465/929] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:21 2022] GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:47:22.533055 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-6f70701a-c0b0-4b39-ac46-35a0df40ab7d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-190679970", "imageRef": "a66ccacb-7b1e-4f51-9eaf-069a356e0fdb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18dbd310-dea2-4429-9ee9-f4f77e3d7b99"}], "security_groups": [{"name": "tempest-securitygroup--2044184570"}], "key_name": "tempest-keypair-821938727", "user_data": "}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:47:22.645696 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.network.neutron [None req-6f70701a-c0b0-4b39-ac46-35a0df40ab7d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] validate_networks() for [('18dbd310-dea2-4429-9ee9-f4f77e3d7b99', None, None, None, None, None)] {{(pid=129980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:47:22.698233 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-fe6caf27-8faf-4917-b860-a288df7b6d95 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:22.699347 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-fe6caf27-8faf-4917-b860-a288df7b6d95 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:22.705567 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fe6caf27-8faf-4917-b860-a288df7b6d95 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:22.706132 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fe6caf27-8faf-4917-b860-a288df7b6d95 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:22.707129 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fe6caf27-8faf-4917-b860-a288df7b6d95 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:22.707767 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-fe6caf27-8faf-4917-b860-a288df7b6d95 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:22.913437 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-fe6caf27-8faf-4917-b860-a288df7b6d95 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:22.927835 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-fe6caf27-8faf-4917-b860-a288df7b6d95 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:22.929624 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-fe6caf27-8faf-4917-b860-a288df7b6d95 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:22.931166 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-fe6caf27-8faf-4917-b860-a288df7b6d95 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1722 microversion: 2.20 time: 0.237681 Jul 12 14:47:22.931812 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 466/930] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:47:22 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:47:23.149658 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-6f70701a-c0b0-4b39-ac46-35a0df40ab7d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Flavor limits 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:47:23.150239 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-6f70701a-c0b0-4b39-ac46-35a0df40ab7d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Image limits 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:47:23.150557 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-6f70701a-c0b0-4b39-ac46-35a0df40ab7d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Flavor pref 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:47:23.150976 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-6f70701a-c0b0-4b39-ac46-35a0df40ab7d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Image pref 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:47:23.151446 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-6f70701a-c0b0-4b39-ac46-35a0df40ab7d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:47:23.161096 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6f70701a-c0b0-4b39-ac46-35a0df40ab7d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:23.161587 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6f70701a-c0b0-4b39-ac46-35a0df40ab7d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:23.162391 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6f70701a-c0b0-4b39-ac46-35a0df40ab7d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:23.162832 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6f70701a-c0b0-4b39-ac46-35a0df40ab7d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:23.180505 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-6f70701a-c0b0-4b39-ac46-35a0df40ab7d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Getting quotas for project 35438fec2e37438e99201870e0d650af. Resources: {'instances', 'cores', 'ram'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:47:23.184696 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-6f70701a-c0b0-4b39-ac46-35a0df40ab7d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Getting quotas for user f926d674e2dc4eb58d7fe6379b79310b and project 35438fec2e37438e99201870e0d650af. Resources: {'instances', 'cores', 'ram'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:47:23.191000 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-b215c29c-f35d-4ee0-821c-d4bba1754524 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:23.191605 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-b215c29c-f35d-4ee0-821c-d4bba1754524 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 042348db-3a7f-47c5-8d26-336846b56bf1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:23.196935 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-6f70701a-c0b0-4b39-ac46-35a0df40ab7d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Going to run 1 instances... {{(pid=129980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:47:23.198660 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b215c29c-f35d-4ee0-821c-d4bba1754524 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:23.199070 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b215c29c-f35d-4ee0-821c-d4bba1754524 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:23.199361 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-6f70701a-c0b0-4b39-ac46-35a0df40ab7d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a66ccacb-7b1e-4f51-9eaf-069a356e0fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:47:23.199912 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b215c29c-f35d-4ee0-821c-d4bba1754524 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:23.200345 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b215c29c-f35d-4ee0-821c-d4bba1754524 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:23.331161 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-6f70701a-c0b0-4b39-ac46-35a0df40ab7d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.803656 Jul 12 14:47:23.332220 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 465/931] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Jul 12 14:47:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:47:23.347250 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-f736c779-65ac-42a0-90d9-163addbfc7c8 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:23.352106 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-f736c779-65ac-42a0-90d9-163addbfc7c8 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:23.478779 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-f736c779-65ac-42a0-90d9-163addbfc7c8 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:23.484080 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-b215c29c-f35d-4ee0-821c-d4bba1754524 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:23.490528 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-f736c779-65ac-42a0-90d9-163addbfc7c8 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e" status: 200 len: 1240 microversion: 2.1 time: 0.151469 Jul 12 14:47:23.499859 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-b215c29c-f35d-4ee0-821c-d4bba1754524 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1" status: 200 len: 1319 microversion: 2.1 time: 0.304739 Jul 12 14:47:23.499859 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 467/932] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:23 2022] GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1 => generated 1319 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:47:23.500246 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 466/933] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:23 2022] GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e => generated 1240 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:23.951752 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-57eabbf1-ad49-4b4f-b68f-cf6aff707d93 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:23.953672 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-57eabbf1-ad49-4b4f-b68f-cf6aff707d93 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:23.964763 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-57eabbf1-ad49-4b4f-b68f-cf6aff707d93 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:23.965985 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-57eabbf1-ad49-4b4f-b68f-cf6aff707d93 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:23.967463 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-57eabbf1-ad49-4b4f-b68f-cf6aff707d93 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:23.968084 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-57eabbf1-ad49-4b4f-b68f-cf6aff707d93 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:24.170377 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-57eabbf1-ad49-4b4f-b68f-cf6aff707d93 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:24.178781 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-57eabbf1-ad49-4b4f-b68f-cf6aff707d93 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:24.180449 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-57eabbf1-ad49-4b4f-b68f-cf6aff707d93 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:24.181657 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-57eabbf1-ad49-4b4f-b68f-cf6aff707d93 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1722 microversion: 2.20 time: 0.235877 Jul 12 14:47:24.182426 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 468/934] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:47:23 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:47:24.453249 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-bb71e30c-456f-4692-bdfa-f2d34dfe0127 req-9da05a29-a7da-4d9c-997d-1ddcbb190d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80951178-6d64-4856-a450-a1e1b64c2586", "name": "network-vif-deleted", "tag": "46daa7fa-cab1-4811-a00f-fa4746971c05"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:47:24.463203 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-bb71e30c-456f-4692-bdfa-f2d34dfe0127 req-9da05a29-a7da-4d9c-997d-1ddcbb190d99 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:24.463653 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-bb71e30c-456f-4692-bdfa-f2d34dfe0127 req-9da05a29-a7da-4d9c-997d-1ddcbb190d99 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:24.474966 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-bb71e30c-456f-4692-bdfa-f2d34dfe0127 req-9da05a29-a7da-4d9c-997d-1ddcbb190d99 service nova] Creating event network-vif-deleted:46daa7fa-cab1-4811-a00f-fa4746971c05 for instance 80951178-6d64-4856-a450-a1e1b64c2586 on hv-cinder-82002 Jul 12 14:47:24.479831 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-bb71e30c-456f-4692-bdfa-f2d34dfe0127 req-9da05a29-a7da-4d9c-997d-1ddcbb190d99 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030266 Jul 12 14:47:24.480442 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 467/935] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:47:24.508465 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-8cfbaec6-c39e-47ce-b612-cd39ddab11cc tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:24.509700 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-8cfbaec6-c39e-47ce-b612-cd39ddab11cc tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:24.511680 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-554b0e98-e3ae-4efc-b4ba-b8209baeb39c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:24.512726 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-554b0e98-e3ae-4efc-b4ba-b8209baeb39c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 042348db-3a7f-47c5-8d26-336846b56bf1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:24.518025 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8cfbaec6-c39e-47ce-b612-cd39ddab11cc tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:24.520603 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-554b0e98-e3ae-4efc-b4ba-b8209baeb39c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:24.520861 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8cfbaec6-c39e-47ce-b612-cd39ddab11cc tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:24.521370 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-554b0e98-e3ae-4efc-b4ba-b8209baeb39c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:24.522559 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-554b0e98-e3ae-4efc-b4ba-b8209baeb39c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:24.523000 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8cfbaec6-c39e-47ce-b612-cd39ddab11cc tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:24.523126 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-554b0e98-e3ae-4efc-b4ba-b8209baeb39c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:24.524024 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8cfbaec6-c39e-47ce-b612-cd39ddab11cc tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:24.622816 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-8cfbaec6-c39e-47ce-b612-cd39ddab11cc tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:24.633784 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-8cfbaec6-c39e-47ce-b612-cd39ddab11cc tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e" status: 200 len: 1244 microversion: 2.1 time: 0.129495 Jul 12 14:47:24.645589 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 469/936] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:24 2022] GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e => generated 1244 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:24.697186 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-554b0e98-e3ae-4efc-b4ba-b8209baeb39c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:24.705460 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-554b0e98-e3ae-4efc-b4ba-b8209baeb39c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1" status: 200 len: 1319 microversion: 2.1 time: 0.199397 Jul 12 14:47:24.706661 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 468/937] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:24 2022] GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:25.199495 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d337bbaa-37cc-44e4-a3aa-7c9fbc943620 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:25.200202 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-d337bbaa-37cc-44e4-a3aa-7c9fbc943620 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:25.207898 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d337bbaa-37cc-44e4-a3aa-7c9fbc943620 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:25.208534 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d337bbaa-37cc-44e4-a3aa-7c9fbc943620 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:25.209334 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d337bbaa-37cc-44e4-a3aa-7c9fbc943620 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:25.209936 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d337bbaa-37cc-44e4-a3aa-7c9fbc943620 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:25.283101 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d337bbaa-37cc-44e4-a3aa-7c9fbc943620 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:25.292436 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d337bbaa-37cc-44e4-a3aa-7c9fbc943620 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:25.293952 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d337bbaa-37cc-44e4-a3aa-7c9fbc943620 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a760d437b597441fa9a4595995c5bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f550f8d11a74b8da5ad84607b79ac37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:25.295108 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-d337bbaa-37cc-44e4-a3aa-7c9fbc943620 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 200 len: 1655 microversion: 2.20 time: 0.099568 Jul 12 14:47:25.295985 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 470/938] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:47:25 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 1655 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:47:25.649819 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-50133d8e-a6e6-4c46-9ed4-6e84e0cd356e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:25.650416 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-50133d8e-a6e6-4c46-9ed4-6e84e0cd356e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:25.656973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-50133d8e-a6e6-4c46-9ed4-6e84e0cd356e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:25.657459 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-50133d8e-a6e6-4c46-9ed4-6e84e0cd356e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:25.658367 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-50133d8e-a6e6-4c46-9ed4-6e84e0cd356e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:25.658807 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-50133d8e-a6e6-4c46-9ed4-6e84e0cd356e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:25.719103 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-50133d8e-a6e6-4c46-9ed4-6e84e0cd356e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:25.725063 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-149ef26d-c5b0-41ef-aae0-60f79c3ff9cf tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:25.725942 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-149ef26d-c5b0-41ef-aae0-60f79c3ff9cf tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 042348db-3a7f-47c5-8d26-336846b56bf1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:25.728543 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-50133d8e-a6e6-4c46-9ed4-6e84e0cd356e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e" status: 200 len: 1236 microversion: 2.1 time: 0.082585 Jul 12 14:47:25.729112 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 469/939] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:25 2022] GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e => generated 1236 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:25.734036 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-149ef26d-c5b0-41ef-aae0-60f79c3ff9cf tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:25.734539 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-149ef26d-c5b0-41ef-aae0-60f79c3ff9cf tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:25.735363 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-149ef26d-c5b0-41ef-aae0-60f79c3ff9cf tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:25.735911 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-149ef26d-c5b0-41ef-aae0-60f79c3ff9cf tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:25.879830 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-149ef26d-c5b0-41ef-aae0-60f79c3ff9cf tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:25.887325 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-149ef26d-c5b0-41ef-aae0-60f79c3ff9cf tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1" status: 200 len: 1319 microversion: 2.1 time: 0.168423 Jul 12 14:47:25.887889 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 471/940] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:25 2022] GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:47:26.313422 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-7ca6f10f-9c95-49f5-8eb1-abd7691ed999 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:26.314030 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-7ca6f10f-9c95-49f5-8eb1-abd7691ed999 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:26.319976 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7ca6f10f-9c95-49f5-8eb1-abd7691ed999 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:26.321025 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7ca6f10f-9c95-49f5-8eb1-abd7691ed999 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:26.321822 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7ca6f10f-9c95-49f5-8eb1-abd7691ed999 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:26.322257 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7ca6f10f-9c95-49f5-8eb1-abd7691ed999 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:26.336229 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.wsgi [None req-7ca6f10f-9c95-49f5-8eb1-abd7691ed999 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] HTTP exception thrown: Instance 80951178-6d64-4856-a450-a1e1b64c2586 could not be found. Jul 12 14:47:26.337908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-7ca6f10f-9c95-49f5-8eb1-abd7691ed999 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Request method failure captured: Jul 12 14:47:26.337908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: request: GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 HTTP/1.1 Jul 12 14:47:26.337908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept: application/json Jul 12 14:47:26.337908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept-Encoding: identity Jul 12 14:47:26.337908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Connection: close Jul 12 14:47:26.337908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Length: 0 Jul 12 14:47:26.337908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Type: application/json Jul 12 14:47:26.337908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Host: 10.222.0.30 Jul 12 14:47:26.337908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Openstack-System-Scope: None Jul 12 14:47:26.337908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: User-Agent: python-urllib3/1.26.9 Jul 12 14:47:26.337908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Auth-Token: gAAAAABizYejT2P3PiUiEByA0PbthfldEiHy-gqWe4ATY_chIHCmw1L4xElkXSKZFoveQ2Vy9e6GTBHKsq6PzAANaD1hqevHlqvWzCwKlSXOX29eu6zKkuQ4T2Vx7BSS8d6YyFqglKlOjCEvJ_v29O9Hr8yZz3RfWPLKznIZhJmQLG8C7m9nDUs Jul 12 14:47:26.337908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Id: None Jul 12 14:47:26.337908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Name: None Jul 12 14:47:26.337908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Identity-Status: Confirmed Jul 12 14:47:26.337908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Is-Admin-Project: True Jul 12 14:47:26.337908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 14:47:26.337908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Id: default Jul 12 14:47:26.337908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Name: Default Jul 12 14:47:26.337908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Id: 3f550f8d11a74b8da5ad84607b79ac37 Jul 12 14:47:26.337908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-176723160 Jul 12 14:47:26.337908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Role: member,reader Jul 12 14:47:26.337908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Roles: member,reader Jul 12 14:47:26.339600 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f550f8d11a74b8da5ad84607b79ac37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f550f8d11a74b8da5ad84607b79ac37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f550f8d11a74b8da5ad84607b79ac37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f550f8d11a74b8da5ad84607b79ac37", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:47:26.339600 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant: tempest-AttachVolumeShelveTestJSON-176723160 Jul 12 14:47:26.339600 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Id: 3f550f8d11a74b8da5ad84607b79ac37 Jul 12 14:47:26.339600 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-176723160 Jul 12 14:47:26.339600 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User: tempest-AttachVolumeShelveTestJSON-176723160-project Jul 12 14:47:26.339600 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Id: default Jul 12 14:47:26.339600 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Name: Default Jul 12 14:47:26.339600 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Id: a760d437b597441fa9a4595995c5bc6f Jul 12 14:47:26.339600 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Name: tempest-AttachVolumeShelveTestJSON-176723160-project Jul 12 14:47:26.339600 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: method: > Jul 12 14:47:26.339600 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: exception: Instance 80951178-6d64-4856-a450-a1e1b64c2586 could not be found. Jul 12 14:47:26.339600 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: action_args: {'id': '80951178-6d64-4856-a450-a1e1b64c2586'} Jul 12 14:47:26.340402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:47:26.340402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:26.340402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:47:26.340402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:47:26.340402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:47:26.340402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:47:26.340402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:47:26.340402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:47:26.340402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:47:26.340402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:47:26.340402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80951178-6d64-4856-a450-a1e1b64c2586 could not be found. Jul 12 14:47:26.340402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:47:26.340402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:47:26.340402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:47:26.340402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:26.340402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:47:26.340402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:47:26.340402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:47:26.340402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:47:26.340402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:47:26.341861 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:47:26.341861 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:47:26.341861 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:47:26.341861 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:47:26.341861 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:47:26.341861 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:47:26.341861 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:47:26.341861 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80951178-6d64-4856-a450-a1e1b64c2586 could not be found. Jul 12 14:47:26.341861 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:47:26.341861 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:47:26.341861 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:47:26.341861 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:26.341861 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:47:26.341861 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:47:26.341861 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:47:26.341861 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:47:26.341861 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80951178-6d64-4856-a450-a1e1b64c2586 could not be found. Jul 12 14:47:26.341861 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:47:26.343252 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-7ca6f10f-9c95-49f5-8eb1-abd7691ed999 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Returning 404 to user: Instance 80951178-6d64-4856-a450-a1e1b64c2586 could not be found. {{(pid=129980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:47:26.343252 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-7ca6f10f-9c95-49f5-8eb1-abd7691ed999 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 404 len: 111 microversion: 2.20 time: 0.029846 Jul 12 14:47:26.343252 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 470/941] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:47:26 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 14:47:26.348373 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-07656963-6249-474f-b6c4-0a4b3c7a37ab tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '.version_select at 0x7f962c804430>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:26.513255 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-07656963-6249-474f-b6c4-0a4b3c7a37ab tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1154020839" status: 204 len: 0 microversion: 2.20 time: 0.168733 Jul 12 14:47:26.513833 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 472/942] 10.222.0.30 () {60 vars in 1261 bytes} [Tue Jul 12 14:47:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1154020839 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 12 14:47:26.745886 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-437d6721-f3ee-4a0f-9c0b-ac42eed4190a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:26.746499 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-437d6721-f3ee-4a0f-9c0b-ac42eed4190a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:26.753063 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-437d6721-f3ee-4a0f-9c0b-ac42eed4190a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:26.754142 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-437d6721-f3ee-4a0f-9c0b-ac42eed4190a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:26.755273 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-437d6721-f3ee-4a0f-9c0b-ac42eed4190a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:26.755716 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-437d6721-f3ee-4a0f-9c0b-ac42eed4190a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:26.821629 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-437d6721-f3ee-4a0f-9c0b-ac42eed4190a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:26.829526 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-437d6721-f3ee-4a0f-9c0b-ac42eed4190a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e" status: 200 len: 1300 microversion: 2.1 time: 0.088111 Jul 12 14:47:26.830443 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 471/943] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:26 2022] GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e => generated 1300 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:26.906862 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-4c80fceb-cbb9-45ca-a49c-44255331dbf3 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:26.907526 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-4c80fceb-cbb9-45ca-a49c-44255331dbf3 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 042348db-3a7f-47c5-8d26-336846b56bf1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:26.916270 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4c80fceb-cbb9-45ca-a49c-44255331dbf3 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:26.916992 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4c80fceb-cbb9-45ca-a49c-44255331dbf3 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:26.917796 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4c80fceb-cbb9-45ca-a49c-44255331dbf3 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:26.918280 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4c80fceb-cbb9-45ca-a49c-44255331dbf3 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:27.384327 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell0:SELECT=2 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:47:27.396311 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-4c80fceb-cbb9-45ca-a49c-44255331dbf3 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:27.406208 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-4c80fceb-cbb9-45ca-a49c-44255331dbf3 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1" status: 200 len: 1319 microversion: 2.1 time: 0.505436 Jul 12 14:47:27.407423 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 473/944] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:26 2022] GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1 => generated 1319 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:27.847796 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0cc68a22-ede0-4edd-a11a-b6a94a49278f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:27.848761 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-0cc68a22-ede0-4edd-a11a-b6a94a49278f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:27.857093 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0cc68a22-ede0-4edd-a11a-b6a94a49278f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:27.871529 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0cc68a22-ede0-4edd-a11a-b6a94a49278f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:27.871529 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0cc68a22-ede0-4edd-a11a-b6a94a49278f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:27.871529 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0cc68a22-ede0-4edd-a11a-b6a94a49278f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:28.008975 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-0cc68a22-ede0-4edd-a11a-b6a94a49278f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:28.017060 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-0cc68a22-ede0-4edd-a11a-b6a94a49278f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e" status: 200 len: 1366 microversion: 2.1 time: 0.173417 Jul 12 14:47:28.018068 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 472/945] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:27 2022] GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:28.424323 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-0af4819a-6a59-4747-9867-493611589b35 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:28.425011 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-0af4819a-6a59-4747-9867-493611589b35 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 042348db-3a7f-47c5-8d26-336846b56bf1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:28.433063 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0af4819a-6a59-4747-9867-493611589b35 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:28.433795 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0af4819a-6a59-4747-9867-493611589b35 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:28.434387 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0af4819a-6a59-4747-9867-493611589b35 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:28.434827 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0af4819a-6a59-4747-9867-493611589b35 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:28.513046 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-2d0c406c-c6e3-4fb0-848f-b35ea12a0249 req-80593eb9-aec3-4d7e-bd28-6e2f95b82baa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beb4b4d2-0edd-494b-958c-72c59082d35e", "tag": "84a8a16c-7c5d-4a9f-9c5b-153879673de1"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:47:28.530328 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-2d0c406c-c6e3-4fb0-848f-b35ea12a0249 req-80593eb9-aec3-4d7e-bd28-6e2f95b82baa service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:28.531113 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-2d0c406c-c6e3-4fb0-848f-b35ea12a0249 req-80593eb9-aec3-4d7e-bd28-6e2f95b82baa service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:28.534417 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=86 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:47:28.544287 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-2d0c406c-c6e3-4fb0-848f-b35ea12a0249 req-80593eb9-aec3-4d7e-bd28-6e2f95b82baa service nova] Creating event network-changed:84a8a16c-7c5d-4a9f-9c5b-153879673de1 for instance beb4b4d2-0edd-494b-958c-72c59082d35e on hv-cinder-82002 Jul 12 14:47:28.548909 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-2d0c406c-c6e3-4fb0-848f-b35ea12a0249 req-80593eb9-aec3-4d7e-bd28-6e2f95b82baa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040808 Jul 12 14:47:28.553113 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 473/946] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:47:28.588460 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-0af4819a-6a59-4747-9867-493611589b35 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:28.596459 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-0af4819a-6a59-4747-9867-493611589b35 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1" status: 200 len: 1319 microversion: 2.1 time: 0.176488 Jul 12 14:47:28.597044 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 474/947] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:28 2022] GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:29.036063 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-f88c5b45-bf82-453b-b160-82dbd2c6a605 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:29.036851 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-f88c5b45-bf82-453b-b160-82dbd2c6a605 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:29.043438 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f88c5b45-bf82-453b-b160-82dbd2c6a605 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:29.043927 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f88c5b45-bf82-453b-b160-82dbd2c6a605 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:29.044695 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f88c5b45-bf82-453b-b160-82dbd2c6a605 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:29.045174 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f88c5b45-bf82-453b-b160-82dbd2c6a605 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:29.131712 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-64ce9595-7bb9-4653-a550-e5f55f817255 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:29.132284 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-64ce9595-7bb9-4653-a550-e5f55f817255 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:29.140977 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-64ce9595-7bb9-4653-a550-e5f55f817255 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:29.141630 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-64ce9595-7bb9-4653-a550-e5f55f817255 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:29.142513 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-64ce9595-7bb9-4653-a550-e5f55f817255 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:29.143010 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-64ce9595-7bb9-4653-a550-e5f55f817255 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:29.157083 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.wsgi [None req-64ce9595-7bb9-4653-a550-e5f55f817255 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] HTTP exception thrown: Instance 80951178-6d64-4856-a450-a1e1b64c2586 could not be found. Jul 12 14:47:29.159220 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-64ce9595-7bb9-4653-a550-e5f55f817255 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Request method failure captured: Jul 12 14:47:29.159220 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: DELETE /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 HTTP/1.1 Jul 12 14:47:29.159220 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:47:29.159220 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:47:29.159220 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:47:29.159220 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 0 Jul 12 14:47:29.159220 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:47:29.159220 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:47:29.159220 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:47:29.159220 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:47:29.159220 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYejT2P3PiUiEByA0PbthfldEiHy-gqWe4ATY_chIHCmw1L4xElkXSKZFoveQ2Vy9e6GTBHKsq6PzAANaD1hqevHlqvWzCwKlSXOX29eu6zKkuQ4T2Vx7BSS8d6YyFqglKlOjCEvJ_v29O9Hr8yZz3RfWPLKznIZhJmQLG8C7m9nDUs Jul 12 14:47:29.159220 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:47:29.159220 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:47:29.159220 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:47:29.159220 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:47:29.159220 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 14:47:29.159220 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:47:29.159220 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:47:29.159220 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: 3f550f8d11a74b8da5ad84607b79ac37 Jul 12 14:47:29.159220 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-176723160 Jul 12 14:47:29.159220 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:47:29.159220 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:47:29.160864 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f550f8d11a74b8da5ad84607b79ac37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f550f8d11a74b8da5ad84607b79ac37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f550f8d11a74b8da5ad84607b79ac37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f550f8d11a74b8da5ad84607b79ac37", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:47:29.160864 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-AttachVolumeShelveTestJSON-176723160 Jul 12 14:47:29.160864 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: 3f550f8d11a74b8da5ad84607b79ac37 Jul 12 14:47:29.160864 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-176723160 Jul 12 14:47:29.160864 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-AttachVolumeShelveTestJSON-176723160-project Jul 12 14:47:29.160864 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:47:29.160864 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:47:29.160864 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: a760d437b597441fa9a4595995c5bc6f Jul 12 14:47:29.160864 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-AttachVolumeShelveTestJSON-176723160-project Jul 12 14:47:29.160864 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: > Jul 12 14:47:29.160864 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Instance 80951178-6d64-4856-a450-a1e1b64c2586 could not be found. Jul 12 14:47:29.160864 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'id': '80951178-6d64-4856-a450-a1e1b64c2586'} Jul 12 14:47:29.161851 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:47:29.161851 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:29.161851 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:47:29.161851 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:47:29.161851 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:47:29.161851 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:47:29.161851 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:47:29.161851 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:47:29.161851 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:47:29.161851 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:47:29.161851 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80951178-6d64-4856-a450-a1e1b64c2586 could not be found. Jul 12 14:47:29.161851 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:47:29.161851 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:47:29.161851 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:47:29.161851 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:29.161851 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:47:29.161851 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:47:29.161851 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:47:29.161851 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:47:29.161851 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:47:29.163424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:47:29.163424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 14:47:29.163424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 14:47:29.163424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 14:47:29.163424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 14:47:29.163424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:47:29.163424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:47:29.163424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:47:29.163424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:47:29.163424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80951178-6d64-4856-a450-a1e1b64c2586 could not be found. Jul 12 14:47:29.163424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:47:29.163424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:47:29.163424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:47:29.163424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:29.163424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:47:29.163424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:47:29.163424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:47:29.163424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:47:29.163424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80951178-6d64-4856-a450-a1e1b64c2586 could not be found. Jul 12 14:47:29.163424 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:47:29.165973 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-64ce9595-7bb9-4653-a550-e5f55f817255 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Returning 404 to user: Instance 80951178-6d64-4856-a450-a1e1b64c2586 could not be found. {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:47:29.167071 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-64ce9595-7bb9-4653-a550-e5f55f817255 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "DELETE /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 404 len: 111 microversion: 2.20 time: 0.039967 Jul 12 14:47:29.168200 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 475/948] 10.222.0.30 () {60 vars in 1279 bytes} [Tue Jul 12 14:47:29 2022] DELETE /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 14:47:29.176507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e2a22c48-38c5-4a1e-97ae-3a1d0244d0df tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:29.177374 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-e2a22c48-38c5-4a1e-97ae-3a1d0244d0df tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 80951178-6d64-4856-a450-a1e1b64c2586] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:29.185094 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e2a22c48-38c5-4a1e-97ae-3a1d0244d0df tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:29.186174 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e2a22c48-38c5-4a1e-97ae-3a1d0244d0df tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:29.186842 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e2a22c48-38c5-4a1e-97ae-3a1d0244d0df tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:29.187441 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e2a22c48-38c5-4a1e-97ae-3a1d0244d0df tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:29.204604 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-f88c5b45-bf82-453b-b160-82dbd2c6a605 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:29.205782 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.wsgi [None req-e2a22c48-38c5-4a1e-97ae-3a1d0244d0df tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] HTTP exception thrown: Instance 80951178-6d64-4856-a450-a1e1b64c2586 could not be found. Jul 12 14:47:29.207709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e2a22c48-38c5-4a1e-97ae-3a1d0244d0df tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Request method failure captured: Jul 12 14:47:29.207709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 HTTP/1.1 Jul 12 14:47:29.207709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:47:29.207709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:47:29.207709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:47:29.207709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 0 Jul 12 14:47:29.207709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:47:29.207709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:47:29.207709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:47:29.207709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:47:29.207709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYejT2P3PiUiEByA0PbthfldEiHy-gqWe4ATY_chIHCmw1L4xElkXSKZFoveQ2Vy9e6GTBHKsq6PzAANaD1hqevHlqvWzCwKlSXOX29eu6zKkuQ4T2Vx7BSS8d6YyFqglKlOjCEvJ_v29O9Hr8yZz3RfWPLKznIZhJmQLG8C7m9nDUs Jul 12 14:47:29.207709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:47:29.207709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:47:29.207709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:47:29.207709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:47:29.207709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 14:47:29.207709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:47:29.207709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:47:29.207709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: 3f550f8d11a74b8da5ad84607b79ac37 Jul 12 14:47:29.207709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-176723160 Jul 12 14:47:29.207709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:47:29.207709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:47:29.209644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f550f8d11a74b8da5ad84607b79ac37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f550f8d11a74b8da5ad84607b79ac37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f550f8d11a74b8da5ad84607b79ac37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f550f8d11a74b8da5ad84607b79ac37", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:47:29.209644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-AttachVolumeShelveTestJSON-176723160 Jul 12 14:47:29.209644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: 3f550f8d11a74b8da5ad84607b79ac37 Jul 12 14:47:29.209644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-176723160 Jul 12 14:47:29.209644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-AttachVolumeShelveTestJSON-176723160-project Jul 12 14:47:29.209644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:47:29.209644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:47:29.209644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: a760d437b597441fa9a4595995c5bc6f Jul 12 14:47:29.209644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-AttachVolumeShelveTestJSON-176723160-project Jul 12 14:47:29.209644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: > Jul 12 14:47:29.209644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Instance 80951178-6d64-4856-a450-a1e1b64c2586 could not be found. Jul 12 14:47:29.209644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'id': '80951178-6d64-4856-a450-a1e1b64c2586'} Jul 12 14:47:29.213745 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:47:29.213745 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:29.213745 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:47:29.213745 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:47:29.213745 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:47:29.213745 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:47:29.213745 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:47:29.213745 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:47:29.213745 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:47:29.213745 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:47:29.213745 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80951178-6d64-4856-a450-a1e1b64c2586 could not be found. Jul 12 14:47:29.213745 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:47:29.213745 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:47:29.213745 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:47:29.213745 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:29.213745 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:47:29.213745 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:47:29.213745 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:47:29.213745 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:47:29.213745 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:47:29.215904 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:47:29.215904 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:47:29.215904 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:47:29.215904 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:47:29.215904 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:47:29.215904 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:47:29.215904 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:47:29.215904 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80951178-6d64-4856-a450-a1e1b64c2586 could not be found. Jul 12 14:47:29.215904 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:47:29.215904 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:47:29.215904 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:47:29.215904 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:29.215904 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:47:29.215904 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:47:29.215904 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:47:29.215904 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:47:29.215904 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80951178-6d64-4856-a450-a1e1b64c2586 could not be found. Jul 12 14:47:29.215904 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:47:29.217070 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e2a22c48-38c5-4a1e-97ae-3a1d0244d0df tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Returning 404 to user: Instance 80951178-6d64-4856-a450-a1e1b64c2586 could not be found. {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:47:29.217070 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-e2a22c48-38c5-4a1e-97ae-3a1d0244d0df tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586" status: 404 len: 111 microversion: 2.20 time: 0.037924 Jul 12 14:47:29.217070 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 476/949] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:47:29 2022] GET /compute/v2.1/servers/80951178-6d64-4856-a450-a1e1b64c2586 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 14:47:29.220216 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-f88c5b45-bf82-453b-b160-82dbd2c6a605 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e" status: 200 len: 1366 microversion: 2.1 time: 0.189142 Jul 12 14:47:29.221776 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 474/950] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:29 2022] GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:29.493789 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-9ee7124f-c4a0-4c9e-b614-dc1fc29edd61 req-711620ce-812e-49da-9be8-edf3c639fb80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "042348db-3a7f-47c5-8d26-336846b56bf1", "name": "network-vif-plugged", "status": "completed", "tag": "fefcfef8-6a7e-4939-8324-f3f2f622a338"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:47:29.504507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-9ee7124f-c4a0-4c9e-b614-dc1fc29edd61 req-711620ce-812e-49da-9be8-edf3c639fb80 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:29.504943 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-9ee7124f-c4a0-4c9e-b614-dc1fc29edd61 req-711620ce-812e-49da-9be8-edf3c639fb80 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:29.515976 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-9ee7124f-c4a0-4c9e-b614-dc1fc29edd61 req-711620ce-812e-49da-9be8-edf3c639fb80 service nova] Creating event network-vif-plugged:fefcfef8-6a7e-4939-8324-f3f2f622a338 for instance 042348db-3a7f-47c5-8d26-336846b56bf1 on hv-cinder-82002 Jul 12 14:47:29.521427 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-9ee7124f-c4a0-4c9e-b614-dc1fc29edd61 req-711620ce-812e-49da-9be8-edf3c639fb80 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033732 Jul 12 14:47:29.522014 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 477/951] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:47:29.612979 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-89174317-2a51-478b-91c9-626c37cdb69c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:29.613609 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-89174317-2a51-478b-91c9-626c37cdb69c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 042348db-3a7f-47c5-8d26-336846b56bf1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:29.620282 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-89174317-2a51-478b-91c9-626c37cdb69c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:29.620725 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-89174317-2a51-478b-91c9-626c37cdb69c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:29.621606 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-89174317-2a51-478b-91c9-626c37cdb69c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:29.622222 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-89174317-2a51-478b-91c9-626c37cdb69c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:29.753557 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-89174317-2a51-478b-91c9-626c37cdb69c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:29.761302 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-89174317-2a51-478b-91c9-626c37cdb69c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1" status: 200 len: 1319 microversion: 2.1 time: 0.152104 Jul 12 14:47:29.761877 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 475/952] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:29 2022] GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:30.237239 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-aef5c10e-794d-4f9d-a72f-e749e24a3105 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:30.237936 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-aef5c10e-794d-4f9d-a72f-e749e24a3105 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:30.244775 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-aef5c10e-794d-4f9d-a72f-e749e24a3105 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:30.245247 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-aef5c10e-794d-4f9d-a72f-e749e24a3105 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:30.246017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-aef5c10e-794d-4f9d-a72f-e749e24a3105 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:30.246448 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-aef5c10e-794d-4f9d-a72f-e749e24a3105 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:30.375827 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-aef5c10e-794d-4f9d-a72f-e749e24a3105 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:30.383508 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-aef5c10e-794d-4f9d-a72f-e749e24a3105 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e" status: 200 len: 1366 microversion: 2.1 time: 0.150647 Jul 12 14:47:30.384068 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 478/953] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:30 2022] GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:30.505881 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-c092f183-4462-4e75-85e1-21e1e5e68825 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:30.506362 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-c092f183-4462-4e75-85e1-21e1e5e68825 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:30.512792 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c092f183-4462-4e75-85e1-21e1e5e68825 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:30.513282 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c092f183-4462-4e75-85e1-21e1e5e68825 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:30.514048 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c092f183-4462-4e75-85e1-21e1e5e68825 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:30.514483 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c092f183-4462-4e75-85e1-21e1e5e68825 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:30.528158 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.wsgi [None req-c092f183-4462-4e75-85e1-21e1e5e68825 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] HTTP exception thrown: Instance 26eeea2d-c1c2-46a7-b727-269cf6dce92a could not be found. Jul 12 14:47:30.529815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-c092f183-4462-4e75-85e1-21e1e5e68825 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Request method failure captured: Jul 12 14:47:30.529815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: request: DELETE /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a HTTP/1.1 Jul 12 14:47:30.529815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept: application/json Jul 12 14:47:30.529815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept-Encoding: identity Jul 12 14:47:30.529815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Connection: close Jul 12 14:47:30.529815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Length: 0 Jul 12 14:47:30.529815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Type: application/json Jul 12 14:47:30.529815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Host: 10.222.0.30 Jul 12 14:47:30.529815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Openstack-System-Scope: None Jul 12 14:47:30.529815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: User-Agent: python-urllib3/1.26.9 Jul 12 14:47:30.529815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Auth-Token: gAAAAABizYejT2P3PiUiEByA0PbthfldEiHy-gqWe4ATY_chIHCmw1L4xElkXSKZFoveQ2Vy9e6GTBHKsq6PzAANaD1hqevHlqvWzCwKlSXOX29eu6zKkuQ4T2Vx7BSS8d6YyFqglKlOjCEvJ_v29O9Hr8yZz3RfWPLKznIZhJmQLG8C7m9nDUs Jul 12 14:47:30.529815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Id: None Jul 12 14:47:30.529815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Name: None Jul 12 14:47:30.529815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Identity-Status: Confirmed Jul 12 14:47:30.529815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Is-Admin-Project: True Jul 12 14:47:30.529815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 14:47:30.529815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Id: default Jul 12 14:47:30.529815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Name: Default Jul 12 14:47:30.529815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Id: 3f550f8d11a74b8da5ad84607b79ac37 Jul 12 14:47:30.529815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-176723160 Jul 12 14:47:30.529815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Role: member,reader Jul 12 14:47:30.529815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Roles: member,reader Jul 12 14:47:30.531530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f550f8d11a74b8da5ad84607b79ac37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f550f8d11a74b8da5ad84607b79ac37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f550f8d11a74b8da5ad84607b79ac37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f550f8d11a74b8da5ad84607b79ac37", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:47:30.531530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant: tempest-AttachVolumeShelveTestJSON-176723160 Jul 12 14:47:30.531530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Id: 3f550f8d11a74b8da5ad84607b79ac37 Jul 12 14:47:30.531530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-176723160 Jul 12 14:47:30.531530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User: tempest-AttachVolumeShelveTestJSON-176723160-project Jul 12 14:47:30.531530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Id: default Jul 12 14:47:30.531530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Name: Default Jul 12 14:47:30.531530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Id: a760d437b597441fa9a4595995c5bc6f Jul 12 14:47:30.531530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Name: tempest-AttachVolumeShelveTestJSON-176723160-project Jul 12 14:47:30.531530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: method: > Jul 12 14:47:30.531530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: exception: Instance 26eeea2d-c1c2-46a7-b727-269cf6dce92a could not be found. Jul 12 14:47:30.531530 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: action_args: {'id': '26eeea2d-c1c2-46a7-b727-269cf6dce92a'} Jul 12 14:47:30.532445 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:47:30.532445 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:30.532445 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:47:30.532445 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:47:30.532445 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:47:30.532445 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:47:30.532445 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:47:30.532445 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:47:30.532445 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:47:30.532445 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:47:30.532445 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26eeea2d-c1c2-46a7-b727-269cf6dce92a could not be found. Jul 12 14:47:30.532445 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:47:30.532445 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:47:30.532445 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:47:30.532445 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:30.532445 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:47:30.532445 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:47:30.532445 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:47:30.532445 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:47:30.532445 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:47:30.534004 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:47:30.534004 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 14:47:30.534004 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 14:47:30.534004 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 14:47:30.534004 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 14:47:30.534004 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:47:30.534004 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:47:30.534004 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:47:30.534004 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:47:30.534004 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26eeea2d-c1c2-46a7-b727-269cf6dce92a could not be found. Jul 12 14:47:30.534004 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:47:30.534004 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:47:30.534004 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:47:30.534004 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:30.534004 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:47:30.534004 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:47:30.534004 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:47:30.534004 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:47:30.534004 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26eeea2d-c1c2-46a7-b727-269cf6dce92a could not be found. Jul 12 14:47:30.534004 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:47:30.535481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-c092f183-4462-4e75-85e1-21e1e5e68825 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Returning 404 to user: Instance 26eeea2d-c1c2-46a7-b727-269cf6dce92a could not be found. {{(pid=129980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:47:30.535481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-c092f183-4462-4e75-85e1-21e1e5e68825 tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "DELETE /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 404 len: 111 microversion: 2.20 time: 0.029493 Jul 12 14:47:30.535481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 476/954] 10.222.0.30 () {60 vars in 1279 bytes} [Tue Jul 12 14:47:30 2022] DELETE /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 14:47:30.540354 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-8f76a8c2-5c13-4bef-b2e9-005a83e113df tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:30.540961 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-8f76a8c2-5c13-4bef-b2e9-005a83e113df tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] [instance: 26eeea2d-c1c2-46a7-b727-269cf6dce92a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:30.547401 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8f76a8c2-5c13-4bef-b2e9-005a83e113df tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:30.547841 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8f76a8c2-5c13-4bef-b2e9-005a83e113df tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:30.548589 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8f76a8c2-5c13-4bef-b2e9-005a83e113df tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:30.549019 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8f76a8c2-5c13-4bef-b2e9-005a83e113df tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:30.565088 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.wsgi [None req-8f76a8c2-5c13-4bef-b2e9-005a83e113df tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] HTTP exception thrown: Instance 26eeea2d-c1c2-46a7-b727-269cf6dce92a could not be found. Jul 12 14:47:30.567525 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-8f76a8c2-5c13-4bef-b2e9-005a83e113df tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Request method failure captured: Jul 12 14:47:30.567525 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a HTTP/1.1 Jul 12 14:47:30.567525 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:47:30.567525 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:47:30.567525 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:47:30.567525 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 0 Jul 12 14:47:30.567525 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:47:30.567525 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:47:30.567525 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:47:30.567525 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:47:30.567525 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYejT2P3PiUiEByA0PbthfldEiHy-gqWe4ATY_chIHCmw1L4xElkXSKZFoveQ2Vy9e6GTBHKsq6PzAANaD1hqevHlqvWzCwKlSXOX29eu6zKkuQ4T2Vx7BSS8d6YyFqglKlOjCEvJ_v29O9Hr8yZz3RfWPLKznIZhJmQLG8C7m9nDUs Jul 12 14:47:30.567525 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:47:30.567525 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:47:30.567525 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:47:30.567525 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:47:30.567525 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 14:47:30.567525 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:47:30.567525 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:47:30.567525 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: 3f550f8d11a74b8da5ad84607b79ac37 Jul 12 14:47:30.567525 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-176723160 Jul 12 14:47:30.567525 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:47:30.567525 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:47:30.568962 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f550f8d11a74b8da5ad84607b79ac37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f550f8d11a74b8da5ad84607b79ac37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f550f8d11a74b8da5ad84607b79ac37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f550f8d11a74b8da5ad84607b79ac37", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:47:30.568962 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-AttachVolumeShelveTestJSON-176723160 Jul 12 14:47:30.568962 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: 3f550f8d11a74b8da5ad84607b79ac37 Jul 12 14:47:30.568962 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-176723160 Jul 12 14:47:30.568962 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-AttachVolumeShelveTestJSON-176723160-project Jul 12 14:47:30.568962 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:47:30.568962 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:47:30.568962 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: a760d437b597441fa9a4595995c5bc6f Jul 12 14:47:30.568962 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-AttachVolumeShelveTestJSON-176723160-project Jul 12 14:47:30.568962 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: > Jul 12 14:47:30.568962 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Instance 26eeea2d-c1c2-46a7-b727-269cf6dce92a could not be found. Jul 12 14:47:30.568962 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'id': '26eeea2d-c1c2-46a7-b727-269cf6dce92a'} Jul 12 14:47:30.573617 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:47:30.573617 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:30.573617 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:47:30.573617 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:47:30.573617 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:47:30.573617 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:47:30.573617 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:47:30.573617 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:47:30.573617 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:47:30.573617 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:47:30.573617 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26eeea2d-c1c2-46a7-b727-269cf6dce92a could not be found. Jul 12 14:47:30.573617 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:47:30.573617 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:47:30.573617 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:47:30.573617 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:30.573617 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:47:30.573617 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:47:30.573617 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:47:30.573617 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:47:30.573617 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:47:30.575262 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:47:30.575262 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:47:30.575262 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:47:30.575262 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:47:30.575262 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:47:30.575262 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:47:30.575262 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:47:30.575262 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26eeea2d-c1c2-46a7-b727-269cf6dce92a could not be found. Jul 12 14:47:30.575262 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:47:30.575262 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:47:30.575262 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:47:30.575262 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:30.575262 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:47:30.575262 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:47:30.575262 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:47:30.575262 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:47:30.575262 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26eeea2d-c1c2-46a7-b727-269cf6dce92a could not be found. Jul 12 14:47:30.575262 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:47:30.577553 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-8f76a8c2-5c13-4bef-b2e9-005a83e113df tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] Returning 404 to user: Instance 26eeea2d-c1c2-46a7-b727-269cf6dce92a could not be found. {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:47:30.577553 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-8f76a8c2-5c13-4bef-b2e9-005a83e113df tempest-AttachVolumeShelveTestJSON-176723160 tempest-AttachVolumeShelveTestJSON-176723160-project] 10.222.0.30 "GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a" status: 404 len: 111 microversion: 2.20 time: 0.033450 Jul 12 14:47:30.577553 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 479/955] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Jul 12 14:47:30 2022] GET /compute/v2.1/servers/26eeea2d-c1c2-46a7-b727-269cf6dce92a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 14:47:30.778697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-6d315b51-dc05-41e2-ae14-e8cb6bcb0999 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:30.779272 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-6d315b51-dc05-41e2-ae14-e8cb6bcb0999 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 042348db-3a7f-47c5-8d26-336846b56bf1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:30.785470 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6d315b51-dc05-41e2-ae14-e8cb6bcb0999 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:30.785925 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6d315b51-dc05-41e2-ae14-e8cb6bcb0999 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:30.786697 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6d315b51-dc05-41e2-ae14-e8cb6bcb0999 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:30.787135 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6d315b51-dc05-41e2-ae14-e8cb6bcb0999 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:30.944665 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-6d315b51-dc05-41e2-ae14-e8cb6bcb0999 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:30.953113 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-6d315b51-dc05-41e2-ae14-e8cb6bcb0999 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1" status: 200 len: 1319 microversion: 2.1 time: 0.178221 Jul 12 14:47:30.953761 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 477/956] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:30 2022] GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:47:31.401122 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-4a913be0-0268-4aba-a5bf-4b2ca3cf59ab tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:31.401768 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-4a913be0-0268-4aba-a5bf-4b2ca3cf59ab tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:31.407987 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4a913be0-0268-4aba-a5bf-4b2ca3cf59ab tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:31.408445 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4a913be0-0268-4aba-a5bf-4b2ca3cf59ab tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:31.409250 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4a913be0-0268-4aba-a5bf-4b2ca3cf59ab tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:31.409925 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4a913be0-0268-4aba-a5bf-4b2ca3cf59ab tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:31.435616 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:47:31.552928 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-4a913be0-0268-4aba-a5bf-4b2ca3cf59ab tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:31.561792 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-4a913be0-0268-4aba-a5bf-4b2ca3cf59ab tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e" status: 200 len: 1366 microversion: 2.1 time: 0.165814 Jul 12 14:47:31.562357 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 480/957] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:31 2022] GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:31.971550 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-a4e4e280-a308-4762-afec-ed553ec6d9f0 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:31.972998 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-a4e4e280-a308-4762-afec-ed553ec6d9f0 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 042348db-3a7f-47c5-8d26-336846b56bf1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:31.981460 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a4e4e280-a308-4762-afec-ed553ec6d9f0 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:31.981912 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a4e4e280-a308-4762-afec-ed553ec6d9f0 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:31.982931 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a4e4e280-a308-4762-afec-ed553ec6d9f0 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:31.983374 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a4e4e280-a308-4762-afec-ed553ec6d9f0 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:32.155170 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-a4e4e280-a308-4762-afec-ed553ec6d9f0 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:32.160421 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-a4e4e280-a308-4762-afec-ed553ec6d9f0 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1" status: 200 len: 1319 microversion: 2.1 time: 0.193562 Jul 12 14:47:32.160991 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 478/958] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:31 2022] GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:32.579726 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-7b2f86e7-db06-4e31-8afd-1fc547163f8f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:32.581126 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-7b2f86e7-db06-4e31-8afd-1fc547163f8f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:32.597318 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7b2f86e7-db06-4e31-8afd-1fc547163f8f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:32.597687 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7b2f86e7-db06-4e31-8afd-1fc547163f8f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:32.598470 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7b2f86e7-db06-4e31-8afd-1fc547163f8f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:32.598907 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7b2f86e7-db06-4e31-8afd-1fc547163f8f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:32.743453 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7b2f86e7-db06-4e31-8afd-1fc547163f8f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:32.753321 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-7b2f86e7-db06-4e31-8afd-1fc547163f8f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e" status: 200 len: 1366 microversion: 2.1 time: 0.177776 Jul 12 14:47:32.754332 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 481/959] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:32 2022] GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:33.178484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-f5c227da-395f-49e6-aa54-b32626e901f9 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:33.179106 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-f5c227da-395f-49e6-aa54-b32626e901f9 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 042348db-3a7f-47c5-8d26-336846b56bf1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:33.181994 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell0:SELECT=4 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:47:33.182746 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:47:33.187669 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f5c227da-395f-49e6-aa54-b32626e901f9 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:33.188124 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f5c227da-395f-49e6-aa54-b32626e901f9 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:33.188892 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f5c227da-395f-49e6-aa54-b32626e901f9 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:33.189372 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f5c227da-395f-49e6-aa54-b32626e901f9 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:33.325404 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-f5c227da-395f-49e6-aa54-b32626e901f9 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:33.332985 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-f5c227da-395f-49e6-aa54-b32626e901f9 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1" status: 200 len: 1319 microversion: 2.1 time: 0.158473 Jul 12 14:47:33.334443 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 479/960] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:33 2022] GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:33.479447 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-84b53273-f016-4ba3-b472-63f5b2de035f req-0d9d8bfd-d56b-4db3-903d-ebcfaba3308b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beb4b4d2-0edd-494b-958c-72c59082d35e", "name": "network-vif-plugged", "status": "completed", "tag": "84a8a16c-7c5d-4a9f-9c5b-153879673de1"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:47:33.495334 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-84b53273-f016-4ba3-b472-63f5b2de035f req-0d9d8bfd-d56b-4db3-903d-ebcfaba3308b service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:33.495968 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-84b53273-f016-4ba3-b472-63f5b2de035f req-0d9d8bfd-d56b-4db3-903d-ebcfaba3308b service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:33.514769 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-84b53273-f016-4ba3-b472-63f5b2de035f req-0d9d8bfd-d56b-4db3-903d-ebcfaba3308b service nova] Creating event network-vif-plugged:84a8a16c-7c5d-4a9f-9c5b-153879673de1 for instance beb4b4d2-0edd-494b-958c-72c59082d35e on hv-cinder-82002 Jul 12 14:47:33.521835 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-84b53273-f016-4ba3-b472-63f5b2de035f req-0d9d8bfd-d56b-4db3-903d-ebcfaba3308b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046561 Jul 12 14:47:33.522656 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 482/961] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:47:33.769458 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-326ad8cf-8729-41b0-8838-ca2f6ee25caa tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:33.770079 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-326ad8cf-8729-41b0-8838-ca2f6ee25caa tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:33.772184 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell0:SELECT=20 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:47:33.777659 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-326ad8cf-8729-41b0-8838-ca2f6ee25caa tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:33.778119 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-326ad8cf-8729-41b0-8838-ca2f6ee25caa tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:33.778894 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-326ad8cf-8729-41b0-8838-ca2f6ee25caa tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:33.779336 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-326ad8cf-8729-41b0-8838-ca2f6ee25caa tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:33.934858 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-326ad8cf-8729-41b0-8838-ca2f6ee25caa tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:33.950071 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-326ad8cf-8729-41b0-8838-ca2f6ee25caa tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e" status: 200 len: 1366 microversion: 2.1 time: 0.178388 Jul 12 14:47:33.950071 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 480/962] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:33 2022] GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:34.352835 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-db057ad2-c2c3-411f-840b-8c168b4fde9c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:34.353636 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-db057ad2-c2c3-411f-840b-8c168b4fde9c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 042348db-3a7f-47c5-8d26-336846b56bf1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:34.372267 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-db057ad2-c2c3-411f-840b-8c168b4fde9c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:34.372742 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-db057ad2-c2c3-411f-840b-8c168b4fde9c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:34.373541 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-db057ad2-c2c3-411f-840b-8c168b4fde9c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:34.374458 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-db057ad2-c2c3-411f-840b-8c168b4fde9c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:34.522626 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-db057ad2-c2c3-411f-840b-8c168b4fde9c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:34.532662 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-db057ad2-c2c3-411f-840b-8c168b4fde9c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1" status: 200 len: 1509 microversion: 2.1 time: 0.184981 Jul 12 14:47:34.542083 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 483/963] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:34 2022] GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1 => generated 1509 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:34.959952 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0d327126-fbcd-4282-a356-cb95a29016fd tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:34.960601 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-0d327126-fbcd-4282-a356-cb95a29016fd tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:34.968510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0d327126-fbcd-4282-a356-cb95a29016fd tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:34.969000 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0d327126-fbcd-4282-a356-cb95a29016fd tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:34.969819 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0d327126-fbcd-4282-a356-cb95a29016fd tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:34.970264 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0d327126-fbcd-4282-a356-cb95a29016fd tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:35.107421 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-0d327126-fbcd-4282-a356-cb95a29016fd tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:35.115761 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-0d327126-fbcd-4282-a356-cb95a29016fd tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e" status: 200 len: 1366 microversion: 2.1 time: 0.159659 Jul 12 14:47:35.116657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 481/964] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:34 2022] GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:36.133801 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-69279193-d43a-4f81-affe-f3a9358ebb84 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:36.134439 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-69279193-d43a-4f81-affe-f3a9358ebb84 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:36.142484 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-69279193-d43a-4f81-affe-f3a9358ebb84 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:36.143137 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-69279193-d43a-4f81-affe-f3a9358ebb84 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:36.143965 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-69279193-d43a-4f81-affe-f3a9358ebb84 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:36.144402 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-69279193-d43a-4f81-affe-f3a9358ebb84 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:36.284176 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-69279193-d43a-4f81-affe-f3a9358ebb84 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:36.295942 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-69279193-d43a-4f81-affe-f3a9358ebb84 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e" status: 200 len: 1366 microversion: 2.1 time: 0.166469 Jul 12 14:47:36.296524 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 484/965] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:36 2022] GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:37.313408 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-77ffe8d8-abbd-4459-907e-fdcd2d82f8eb tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:37.314156 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-77ffe8d8-abbd-4459-907e-fdcd2d82f8eb tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:37.320604 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-77ffe8d8-abbd-4459-907e-fdcd2d82f8eb tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:37.321054 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-77ffe8d8-abbd-4459-907e-fdcd2d82f8eb tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:37.321853 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-77ffe8d8-abbd-4459-907e-fdcd2d82f8eb tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:37.322293 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-77ffe8d8-abbd-4459-907e-fdcd2d82f8eb tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:37.462566 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-77ffe8d8-abbd-4459-907e-fdcd2d82f8eb tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:37.470047 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-77ffe8d8-abbd-4459-907e-fdcd2d82f8eb tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e" status: 200 len: 1556 microversion: 2.1 time: 0.160486 Jul 12 14:47:37.470614 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 482/966] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:37 2022] GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:37.486049 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-5878134c-8ac1-47f7-bcf1-aa12002ded6e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:37.486575 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-5878134c-8ac1-47f7-bcf1-aa12002ded6e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:37.493876 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5878134c-8ac1-47f7-bcf1-aa12002ded6e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:37.494319 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5878134c-8ac1-47f7-bcf1-aa12002ded6e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:37.495074 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5878134c-8ac1-47f7-bcf1-aa12002ded6e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:37.495504 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5878134c-8ac1-47f7-bcf1-aa12002ded6e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:37.577778 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-5878134c-8ac1-47f7-bcf1-aa12002ded6e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095572 Jul 12 14:47:37.578505 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 485/967] 10.222.0.30 () {58 vars in 1274 bytes} [Tue Jul 12 14:47:37 2022] GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:47:38.632030 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-972ddf8c-6376-40ad-8c40-ba4c1d16c372 req-bcf93143-a250-4312-b90a-a414d37e5284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beb4b4d2-0edd-494b-958c-72c59082d35e", "tag": "84a8a16c-7c5d-4a9f-9c5b-153879673de1"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:47:38.640507 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-972ddf8c-6376-40ad-8c40-ba4c1d16c372 req-bcf93143-a250-4312-b90a-a414d37e5284 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:38.640953 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-972ddf8c-6376-40ad-8c40-ba4c1d16c372 req-bcf93143-a250-4312-b90a-a414d37e5284 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:38.652014 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-972ddf8c-6376-40ad-8c40-ba4c1d16c372 req-bcf93143-a250-4312-b90a-a414d37e5284 service nova] Creating event network-changed:84a8a16c-7c5d-4a9f-9c5b-153879673de1 for instance beb4b4d2-0edd-494b-958c-72c59082d35e on hv-cinder-82002 Jul 12 14:47:38.657548 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-972ddf8c-6376-40ad-8c40-ba4c1d16c372 req-bcf93143-a250-4312-b90a-a414d37e5284 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029218 Jul 12 14:47:38.658228 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 483/968] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:47:54.271449 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:47:54.272194 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=26 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:47:54.277109 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-a7680bf0-899b-457a-b82f-f95a183aa39b tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "485dca48-71c1-4c98-8902-d48c904901c2", "device": "/dev/sdb"}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:47:54.280804 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-a7680bf0-899b-457a-b82f-f95a183aa39b tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 042348db-3a7f-47c5-8d26-336846b56bf1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:54.285953 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a7680bf0-899b-457a-b82f-f95a183aa39b tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:54.286491 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a7680bf0-899b-457a-b82f-f95a183aa39b tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:54.287252 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a7680bf0-899b-457a-b82f-f95a183aa39b tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:54.287683 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a7680bf0-899b-457a-b82f-f95a183aa39b tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:55.179036 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-a7680bf0-899b-457a-b82f-f95a183aa39b tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "POST /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.908846 Jul 12 14:47:55.187204 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 486/969] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Jul 12 14:47:54 2022] POST /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1/os-volume_attachments => generated 194 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:48:01.195524 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_api:SELECT=9 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:48:01.196328 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=53 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:48:01.201132 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-65f1ce58-16cb-4140-aec2-315ce07a314e tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:48:01.201819 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-65f1ce58-16cb-4140-aec2-315ce07a314e tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:01.207899 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-65f1ce58-16cb-4140-aec2-315ce07a314e tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:01.208422 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-65f1ce58-16cb-4140-aec2-315ce07a314e tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:01.209192 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-65f1ce58-16cb-4140-aec2-315ce07a314e tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:01.209631 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-65f1ce58-16cb-4140-aec2-315ce07a314e tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:01.232705 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.objects.instance [None req-65f1ce58-16cb-4140-aec2-315ce07a314e tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lazy-loading 'flavor' on Instance uuid 336f3e15-d106-4a54-b655-49328b81248d {{(pid=129980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:48:01.562667 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-65f1ce58-16cb-4140-aec2-315ce07a314e tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "POST /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d/action" status: 202 len: 0 microversion: 2.1 time: 0.368496 Jul 12 14:48:01.563263 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 484/970] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Jul 12 14:48:01 2022] POST /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:48:01.574060 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-ec3b350c-e8dc-4012-87f6-cb45d9584803 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:01.575540 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-ec3b350c-e8dc-4012-87f6-cb45d9584803 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:01.582011 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ec3b350c-e8dc-4012-87f6-cb45d9584803 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:01.582456 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ec3b350c-e8dc-4012-87f6-cb45d9584803 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:01.583212 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ec3b350c-e8dc-4012-87f6-cb45d9584803 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:01.583642 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ec3b350c-e8dc-4012-87f6-cb45d9584803 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:01.718249 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-ec3b350c-e8dc-4012-87f6-cb45d9584803 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:01.725710 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-ec3b350c-e8dc-4012-87f6-cb45d9584803 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1568 microversion: 2.1 time: 0.157775 Jul 12 14:48:01.726279 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 487/971] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:01 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:02.744703 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-5ba06721-1556-438d-92eb-5fc6da36f1fb tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:02.745456 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-5ba06721-1556-438d-92eb-5fc6da36f1fb tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:02.751583 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5ba06721-1556-438d-92eb-5fc6da36f1fb tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:02.752029 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5ba06721-1556-438d-92eb-5fc6da36f1fb tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:02.752792 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5ba06721-1556-438d-92eb-5fc6da36f1fb tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:02.753524 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5ba06721-1556-438d-92eb-5fc6da36f1fb tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:02.894757 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-5ba06721-1556-438d-92eb-5fc6da36f1fb tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:02.902678 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-5ba06721-1556-438d-92eb-5fc6da36f1fb tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1568 microversion: 2.1 time: 0.162853 Jul 12 14:48:02.903243 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 485/972] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:02 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:03.920316 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-ee5f5de3-a96e-4325-8c93-56d23ca29a78 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:03.923998 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-ee5f5de3-a96e-4325-8c93-56d23ca29a78 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:03.927495 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ee5f5de3-a96e-4325-8c93-56d23ca29a78 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:03.927935 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ee5f5de3-a96e-4325-8c93-56d23ca29a78 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:03.928696 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ee5f5de3-a96e-4325-8c93-56d23ca29a78 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:03.929124 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ee5f5de3-a96e-4325-8c93-56d23ca29a78 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:04.089597 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-ee5f5de3-a96e-4325-8c93-56d23ca29a78 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:04.097698 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-ee5f5de3-a96e-4325-8c93-56d23ca29a78 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1568 microversion: 2.1 time: 0.181643 Jul 12 14:48:04.098280 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 488/973] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:03 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:05.114967 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-1e274500-68a3-4a41-9b60-dd972348972a tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:05.115500 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-1e274500-68a3-4a41-9b60-dd972348972a tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:05.122525 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1e274500-68a3-4a41-9b60-dd972348972a tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:05.122984 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1e274500-68a3-4a41-9b60-dd972348972a tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:05.123743 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1e274500-68a3-4a41-9b60-dd972348972a tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:05.124270 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1e274500-68a3-4a41-9b60-dd972348972a tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:05.263138 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-1e274500-68a3-4a41-9b60-dd972348972a tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:05.270944 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-1e274500-68a3-4a41-9b60-dd972348972a tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1568 microversion: 2.1 time: 0.159903 Jul 12 14:48:05.271513 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 486/974] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:05 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:06.287851 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-ab21ecb3-ec1f-463c-8ccc-b4e13c5126a0 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:06.289074 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-ab21ecb3-ec1f-463c-8ccc-b4e13c5126a0 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:06.296712 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ab21ecb3-ec1f-463c-8ccc-b4e13c5126a0 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:06.297179 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ab21ecb3-ec1f-463c-8ccc-b4e13c5126a0 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:06.297939 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ab21ecb3-ec1f-463c-8ccc-b4e13c5126a0 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:06.298536 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ab21ecb3-ec1f-463c-8ccc-b4e13c5126a0 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:06.442283 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-ab21ecb3-ec1f-463c-8ccc-b4e13c5126a0 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:06.451542 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-ab21ecb3-ec1f-463c-8ccc-b4e13c5126a0 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1568 microversion: 2.1 time: 0.167517 Jul 12 14:48:06.452196 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 489/975] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:06 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:48:07.468343 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-fbb1f9a9-3d37-4fa2-90aa-376aafca56ad tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:07.468963 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-fbb1f9a9-3d37-4fa2-90aa-376aafca56ad tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:07.475607 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fbb1f9a9-3d37-4fa2-90aa-376aafca56ad tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:07.475992 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fbb1f9a9-3d37-4fa2-90aa-376aafca56ad tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:07.476764 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fbb1f9a9-3d37-4fa2-90aa-376aafca56ad tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:07.477243 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fbb1f9a9-3d37-4fa2-90aa-376aafca56ad tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:07.610487 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-fbb1f9a9-3d37-4fa2-90aa-376aafca56ad tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:07.618123 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-fbb1f9a9-3d37-4fa2-90aa-376aafca56ad tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1568 microversion: 2.1 time: 0.153672 Jul 12 14:48:07.629302 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 487/976] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:07 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:08.639894 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-bef9a7f8-8713-4a67-a887-67f5f5c727f3 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:08.641068 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-bef9a7f8-8713-4a67-a887-67f5f5c727f3 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:08.649662 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bef9a7f8-8713-4a67-a887-67f5f5c727f3 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:08.650418 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bef9a7f8-8713-4a67-a887-67f5f5c727f3 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:08.651053 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bef9a7f8-8713-4a67-a887-67f5f5c727f3 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:08.651655 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bef9a7f8-8713-4a67-a887-67f5f5c727f3 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:08.812789 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-bef9a7f8-8713-4a67-a887-67f5f5c727f3 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:08.820380 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-bef9a7f8-8713-4a67-a887-67f5f5c727f3 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1568 microversion: 2.1 time: 0.186625 Jul 12 14:48:08.820945 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 490/977] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:08 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:09.837692 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-752c292a-9a7d-4f7d-9dfa-a1e9a681b744 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:09.838313 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-752c292a-9a7d-4f7d-9dfa-a1e9a681b744 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:09.844657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-752c292a-9a7d-4f7d-9dfa-a1e9a681b744 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:09.845112 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-752c292a-9a7d-4f7d-9dfa-a1e9a681b744 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:09.845902 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-752c292a-9a7d-4f7d-9dfa-a1e9a681b744 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:09.846343 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-752c292a-9a7d-4f7d-9dfa-a1e9a681b744 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:09.980126 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-752c292a-9a7d-4f7d-9dfa-a1e9a681b744 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:09.987658 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-752c292a-9a7d-4f7d-9dfa-a1e9a681b744 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1568 microversion: 2.1 time: 0.154353 Jul 12 14:48:09.988230 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 488/978] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:09 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:11.004116 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d809c325-e371-495b-b410-c51cbf7b249a tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:11.004723 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-d809c325-e371-495b-b410-c51cbf7b249a tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:11.011153 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d809c325-e371-495b-b410-c51cbf7b249a tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:11.011591 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d809c325-e371-495b-b410-c51cbf7b249a tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:11.012383 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d809c325-e371-495b-b410-c51cbf7b249a tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:11.012814 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d809c325-e371-495b-b410-c51cbf7b249a tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:11.170792 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d809c325-e371-495b-b410-c51cbf7b249a tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:11.178305 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-d809c325-e371-495b-b410-c51cbf7b249a tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1568 microversion: 2.1 time: 0.178264 Jul 12 14:48:11.178978 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 491/979] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:10 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:12.195191 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-92588d64-8269-4b06-9f94-6990a3715764 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:12.195872 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-92588d64-8269-4b06-9f94-6990a3715764 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:12.203356 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-92588d64-8269-4b06-9f94-6990a3715764 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:12.203838 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-92588d64-8269-4b06-9f94-6990a3715764 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:12.204616 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-92588d64-8269-4b06-9f94-6990a3715764 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:12.205056 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-92588d64-8269-4b06-9f94-6990a3715764 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:12.338706 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-92588d64-8269-4b06-9f94-6990a3715764 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:12.346323 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-92588d64-8269-4b06-9f94-6990a3715764 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1568 microversion: 2.1 time: 0.154921 Jul 12 14:48:12.346893 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 489/980] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:12 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:13.363304 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-7fb4da8b-5301-433a-80bd-dd29fba7184c tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:13.363895 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-7fb4da8b-5301-433a-80bd-dd29fba7184c tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:13.370475 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7fb4da8b-5301-433a-80bd-dd29fba7184c tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:13.370923 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7fb4da8b-5301-433a-80bd-dd29fba7184c tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:13.371676 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7fb4da8b-5301-433a-80bd-dd29fba7184c tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:13.372111 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7fb4da8b-5301-433a-80bd-dd29fba7184c tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:13.504514 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7fb4da8b-5301-433a-80bd-dd29fba7184c tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:13.512015 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-7fb4da8b-5301-433a-80bd-dd29fba7184c tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1568 microversion: 2.1 time: 0.152565 Jul 12 14:48:13.512585 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 492/981] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:13 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:14.528432 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-66ef6f5a-af9b-45b4-a5e2-99300b7012d9 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:14.529037 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-66ef6f5a-af9b-45b4-a5e2-99300b7012d9 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:14.535429 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-66ef6f5a-af9b-45b4-a5e2-99300b7012d9 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:14.535880 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-66ef6f5a-af9b-45b4-a5e2-99300b7012d9 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:14.536635 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-66ef6f5a-af9b-45b4-a5e2-99300b7012d9 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:14.537066 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-66ef6f5a-af9b-45b4-a5e2-99300b7012d9 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:14.670851 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-66ef6f5a-af9b-45b4-a5e2-99300b7012d9 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:14.678484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-66ef6f5a-af9b-45b4-a5e2-99300b7012d9 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1568 microversion: 2.1 time: 0.154092 Jul 12 14:48:14.679246 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 490/982] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:14 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:15.695813 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-db42e7fa-b86b-4f49-8027-6737d8109e35 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:15.696426 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-db42e7fa-b86b-4f49-8027-6737d8109e35 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:15.702961 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-db42e7fa-b86b-4f49-8027-6737d8109e35 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:15.703413 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-db42e7fa-b86b-4f49-8027-6737d8109e35 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:15.704177 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-db42e7fa-b86b-4f49-8027-6737d8109e35 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:15.704613 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-db42e7fa-b86b-4f49-8027-6737d8109e35 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:15.834798 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-db42e7fa-b86b-4f49-8027-6737d8109e35 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:15.842857 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-db42e7fa-b86b-4f49-8027-6737d8109e35 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1568 microversion: 2.1 time: 0.150785 Jul 12 14:48:15.843355 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 493/983] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:15 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:16.859870 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ae7d8df4-8a34-4453-a0a8-17f5ee424116 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:16.860481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-ae7d8df4-8a34-4453-a0a8-17f5ee424116 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:16.867077 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ae7d8df4-8a34-4453-a0a8-17f5ee424116 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:16.867520 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ae7d8df4-8a34-4453-a0a8-17f5ee424116 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:16.868863 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ae7d8df4-8a34-4453-a0a8-17f5ee424116 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:16.869333 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ae7d8df4-8a34-4453-a0a8-17f5ee424116 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:17.002253 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ae7d8df4-8a34-4453-a0a8-17f5ee424116 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:17.014758 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ae7d8df4-8a34-4453-a0a8-17f5ee424116 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1568 microversion: 2.1 time: 0.158815 Jul 12 14:48:17.015331 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 491/984] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:16 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:18.031714 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-b452d990-0ab5-4b15-aa01-76b78dde9867 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:18.032325 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-b452d990-0ab5-4b15-aa01-76b78dde9867 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:18.038967 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b452d990-0ab5-4b15-aa01-76b78dde9867 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:18.039415 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b452d990-0ab5-4b15-aa01-76b78dde9867 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:18.040746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b452d990-0ab5-4b15-aa01-76b78dde9867 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:18.041201 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b452d990-0ab5-4b15-aa01-76b78dde9867 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:18.170505 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-b452d990-0ab5-4b15-aa01-76b78dde9867 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:18.178258 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-b452d990-0ab5-4b15-aa01-76b78dde9867 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1568 microversion: 2.1 time: 0.150143 Jul 12 14:48:18.178614 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 494/985] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:18 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:19.195137 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-89fea5e3-d4a8-42b2-891c-6533a3115d3c tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:19.195751 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-89fea5e3-d4a8-42b2-891c-6533a3115d3c tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:19.202442 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-89fea5e3-d4a8-42b2-891c-6533a3115d3c tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:19.202892 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-89fea5e3-d4a8-42b2-891c-6533a3115d3c tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:19.203646 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-89fea5e3-d4a8-42b2-891c-6533a3115d3c tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:19.204079 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-89fea5e3-d4a8-42b2-891c-6533a3115d3c tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:19.337949 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-89fea5e3-d4a8-42b2-891c-6533a3115d3c tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:19.345341 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-89fea5e3-d4a8-42b2-891c-6533a3115d3c tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1568 microversion: 2.1 time: 0.154111 Jul 12 14:48:19.345901 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 492/986] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:19 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:20.363614 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-27529e8d-0678-48f6-aa70-aa22854a6ab1 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:20.364223 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-27529e8d-0678-48f6-aa70-aa22854a6ab1 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:20.371540 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-27529e8d-0678-48f6-aa70-aa22854a6ab1 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:20.372081 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-27529e8d-0678-48f6-aa70-aa22854a6ab1 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:20.372994 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-27529e8d-0678-48f6-aa70-aa22854a6ab1 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:20.373466 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-27529e8d-0678-48f6-aa70-aa22854a6ab1 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:20.503975 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-27529e8d-0678-48f6-aa70-aa22854a6ab1 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:20.511785 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-27529e8d-0678-48f6-aa70-aa22854a6ab1 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1568 microversion: 2.1 time: 0.152340 Jul 12 14:48:20.512355 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 495/987] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:20 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:21.529481 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-6c966d49-fea2-4b19-a95a-472f82c99bdc tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:21.530233 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-6c966d49-fea2-4b19-a95a-472f82c99bdc tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:21.536712 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6c966d49-fea2-4b19-a95a-472f82c99bdc tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:21.537180 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6c966d49-fea2-4b19-a95a-472f82c99bdc tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:21.537957 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6c966d49-fea2-4b19-a95a-472f82c99bdc tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:21.538390 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6c966d49-fea2-4b19-a95a-472f82c99bdc tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:21.675302 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-6c966d49-fea2-4b19-a95a-472f82c99bdc tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:21.682898 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-6c966d49-fea2-4b19-a95a-472f82c99bdc tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1568 microversion: 2.1 time: 0.157384 Jul 12 14:48:21.687126 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 493/988] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:21 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:22.700396 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-f9c615ca-ffe9-408a-a500-a3a729910aca tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:22.701004 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-f9c615ca-ffe9-408a-a500-a3a729910aca tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:22.707671 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f9c615ca-ffe9-408a-a500-a3a729910aca tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:22.710794 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f9c615ca-ffe9-408a-a500-a3a729910aca tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:22.710794 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f9c615ca-ffe9-408a-a500-a3a729910aca tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:22.710794 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f9c615ca-ffe9-408a-a500-a3a729910aca tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:22.841389 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-f9c615ca-ffe9-408a-a500-a3a729910aca tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:22.849011 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-f9c615ca-ffe9-408a-a500-a3a729910aca tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1568 microversion: 2.1 time: 0.153334 Jul 12 14:48:22.849603 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 496/989] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:22 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:23.012041 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-18f15df1-f229-41b2-8764-ac1c56f3969d tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:23.012581 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-18f15df1-f229-41b2-8764-ac1c56f3969d tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 042348db-3a7f-47c5-8d26-336846b56bf1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:23.019266 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-18f15df1-f229-41b2-8764-ac1c56f3969d tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:23.019719 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-18f15df1-f229-41b2-8764-ac1c56f3969d tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:23.020600 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-18f15df1-f229-41b2-8764-ac1c56f3969d tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:23.021036 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-18f15df1-f229-41b2-8764-ac1c56f3969d tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:23.104664 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.objects.instance [None req-18f15df1-f229-41b2-8764-ac1c56f3969d tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lazy-loading 'services' on Instance uuid 042348db-3a7f-47c5-8d26-336846b56bf1 {{(pid=129980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:48:23.384169 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-18f15df1-f229-41b2-8764-ac1c56f3969d tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "DELETE /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1/os-volume_attachments/485dca48-71c1-4c98-8902-d48c904901c2" status: 202 len: 0 microversion: 2.1 time: 0.375984 Jul 12 14:48:23.384770 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 494/990] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Jul 12 14:48:23 2022] DELETE /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1/os-volume_attachments/485dca48-71c1-4c98-8902-d48c904901c2 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:48:23.866385 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-45b59558-70d1-4136-ab69-e63ec3d9f296 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:23.866954 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-45b59558-70d1-4136-ab69-e63ec3d9f296 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:23.873488 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-45b59558-70d1-4136-ab69-e63ec3d9f296 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:23.873934 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-45b59558-70d1-4136-ab69-e63ec3d9f296 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:23.874718 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-45b59558-70d1-4136-ab69-e63ec3d9f296 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:23.875280 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-45b59558-70d1-4136-ab69-e63ec3d9f296 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:24.006991 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-45b59558-70d1-4136-ab69-e63ec3d9f296 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:24.014726 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-45b59558-70d1-4136-ab69-e63ec3d9f296 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1568 microversion: 2.1 time: 0.152479 Jul 12 14:48:24.015314 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 497/991] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:23 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:25.035345 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-a3157b10-2e27-4357-b27c-a42b3048dc3e tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:25.035345 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-a3157b10-2e27-4357-b27c-a42b3048dc3e tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:25.041538 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a3157b10-2e27-4357-b27c-a42b3048dc3e tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:25.042069 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a3157b10-2e27-4357-b27c-a42b3048dc3e tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:25.042913 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a3157b10-2e27-4357-b27c-a42b3048dc3e tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:25.043584 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a3157b10-2e27-4357-b27c-a42b3048dc3e tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:25.184277 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-a3157b10-2e27-4357-b27c-a42b3048dc3e tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:25.191752 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-a3157b10-2e27-4357-b27c-a42b3048dc3e tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1568 microversion: 2.1 time: 0.163637 Jul 12 14:48:25.192318 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 495/992] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:25 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:26.211043 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d0f22683-7d5f-4f78-a7a0-bc16a6f870c6 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:26.211709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-d0f22683-7d5f-4f78-a7a0-bc16a6f870c6 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:26.216378 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_api:SELECT=25 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:48:26.220159 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d0f22683-7d5f-4f78-a7a0-bc16a6f870c6 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:26.220604 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d0f22683-7d5f-4f78-a7a0-bc16a6f870c6 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:26.221400 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d0f22683-7d5f-4f78-a7a0-bc16a6f870c6 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:26.221832 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d0f22683-7d5f-4f78-a7a0-bc16a6f870c6 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:26.226084 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:48:26.354467 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d0f22683-7d5f-4f78-a7a0-bc16a6f870c6 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:26.361935 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-d0f22683-7d5f-4f78-a7a0-bc16a6f870c6 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1568 microversion: 2.1 time: 0.155819 Jul 12 14:48:26.362497 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 498/993] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:26 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:26.612201 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-fa0443f0-1fd0-4a3c-9b57-ed14218399ea tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:26.614890 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-fa0443f0-1fd0-4a3c-9b57-ed14218399ea tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 042348db-3a7f-47c5-8d26-336846b56bf1] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:26.619245 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fa0443f0-1fd0-4a3c-9b57-ed14218399ea tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:26.619689 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fa0443f0-1fd0-4a3c-9b57-ed14218399ea tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:26.620442 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fa0443f0-1fd0-4a3c-9b57-ed14218399ea tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:26.620875 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-fa0443f0-1fd0-4a3c-9b57-ed14218399ea tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:26.646606 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-fa0443f0-1fd0-4a3c-9b57-ed14218399ea tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 042348db-3a7f-47c5-8d26-336846b56bf1] Going to try to terminate instance {{(pid=129980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:48:26.681047 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:48:26.986185 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-fa0443f0-1fd0-4a3c-9b57-ed14218399ea tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "DELETE /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1" status: 204 len: 0 microversion: 2.1 time: 0.377482 Jul 12 14:48:26.986779 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 496/994] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Jul 12 14:48:26 2022] DELETE /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 14:48:27.000983 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-217f63df-cb53-42dd-9e15-1a2ef27a55c6 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:27.000983 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-217f63df-cb53-42dd-9e15-1a2ef27a55c6 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 042348db-3a7f-47c5-8d26-336846b56bf1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:27.004806 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-217f63df-cb53-42dd-9e15-1a2ef27a55c6 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:27.005139 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-217f63df-cb53-42dd-9e15-1a2ef27a55c6 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:27.006143 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-217f63df-cb53-42dd-9e15-1a2ef27a55c6 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:27.006694 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-217f63df-cb53-42dd-9e15-1a2ef27a55c6 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:27.148376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-217f63df-cb53-42dd-9e15-1a2ef27a55c6 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:27.156738 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-217f63df-cb53-42dd-9e15-1a2ef27a55c6 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1" status: 200 len: 1515 microversion: 2.1 time: 0.165442 Jul 12 14:48:27.157363 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 499/995] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:26 2022] GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:27.380418 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-83a7a668-1896-4d2c-942a-d470043cb1ad tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:27.381284 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-83a7a668-1896-4d2c-942a-d470043cb1ad tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:27.387975 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-83a7a668-1896-4d2c-942a-d470043cb1ad tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:27.388431 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-83a7a668-1896-4d2c-942a-d470043cb1ad tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:27.389268 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-83a7a668-1896-4d2c-942a-d470043cb1ad tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:27.389712 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-83a7a668-1896-4d2c-942a-d470043cb1ad tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:27.522462 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-83a7a668-1896-4d2c-942a-d470043cb1ad tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:27.530201 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-83a7a668-1896-4d2c-942a-d470043cb1ad tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1569 microversion: 2.1 time: 0.154680 Jul 12 14:48:27.530795 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 497/996] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:27 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:27.547965 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-836302bd-9d0c-486f-8d54-d6da88c58248 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:48:27.548530 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-836302bd-9d0c-486f-8d54-d6da88c58248 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:27.556171 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-836302bd-9d0c-486f-8d54-d6da88c58248 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:27.556612 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-836302bd-9d0c-486f-8d54-d6da88c58248 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:27.557407 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-836302bd-9d0c-486f-8d54-d6da88c58248 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:27.557823 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-836302bd-9d0c-486f-8d54-d6da88c58248 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:27.684734 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-2ee19125-7dfd-4e32-abcd-ed9cc47bd73e req-bf10376b-9412-4866-a34f-4f2185985e09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "336f3e15-d106-4a54-b655-49328b81248d", "name": "network-vif-unplugged", "status": "completed", "tag": "07cdb948-262b-44e3-a60e-ac8f1916b818"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:48:27.698418 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-2ee19125-7dfd-4e32-abcd-ed9cc47bd73e req-bf10376b-9412-4866-a34f-4f2185985e09 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:27.698956 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-2ee19125-7dfd-4e32-abcd-ed9cc47bd73e req-bf10376b-9412-4866-a34f-4f2185985e09 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:27.710624 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-2ee19125-7dfd-4e32-abcd-ed9cc47bd73e req-bf10376b-9412-4866-a34f-4f2185985e09 service nova] Creating event network-vif-unplugged:07cdb948-262b-44e3-a60e-ac8f1916b818 for instance 336f3e15-d106-4a54-b655-49328b81248d on hv-cinder-82002 Jul 12 14:48:27.715674 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-2ee19125-7dfd-4e32-abcd-ed9cc47bd73e req-bf10376b-9412-4866-a34f-4f2185985e09 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035692 Jul 12 14:48:27.720030 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 498/997] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:48:27.811252 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-836302bd-9d0c-486f-8d54-d6da88c58248 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "POST /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d/action" status: 202 len: 0 microversion: 2.1 time: 0.267148 Jul 12 14:48:27.812384 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 500/998] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Jul 12 14:48:27 2022] POST /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:48:27.825510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-45f7ff0f-fbfc-4670-89e2-7815bea95a73 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:27.827744 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-45f7ff0f-fbfc-4670-89e2-7815bea95a73 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:27.836141 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-45f7ff0f-fbfc-4670-89e2-7815bea95a73 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:27.836835 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-45f7ff0f-fbfc-4670-89e2-7815bea95a73 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:27.838127 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-45f7ff0f-fbfc-4670-89e2-7815bea95a73 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:27.838804 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-45f7ff0f-fbfc-4670-89e2-7815bea95a73 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:27.975997 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-45f7ff0f-fbfc-4670-89e2-7815bea95a73 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:27.984080 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-45f7ff0f-fbfc-4670-89e2-7815bea95a73 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1577 microversion: 2.1 time: 0.167014 Jul 12 14:48:27.984650 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 499/999] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:27 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:28.174583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e317a2c9-f154-4eee-8183-730bc25c01f2 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:28.175193 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-e317a2c9-f154-4eee-8183-730bc25c01f2 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 042348db-3a7f-47c5-8d26-336846b56bf1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:28.182182 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e317a2c9-f154-4eee-8183-730bc25c01f2 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:28.189610 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e317a2c9-f154-4eee-8183-730bc25c01f2 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:28.189610 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e317a2c9-f154-4eee-8183-730bc25c01f2 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:28.189610 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e317a2c9-f154-4eee-8183-730bc25c01f2 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:28.351442 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e317a2c9-f154-4eee-8183-730bc25c01f2 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:28.359185 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-e317a2c9-f154-4eee-8183-730bc25c01f2 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1" status: 200 len: 1515 microversion: 2.1 time: 0.188601 Jul 12 14:48:28.359749 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 501/1000] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:28 2022] GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1 => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:29.002944 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-44fe2fdd-0d62-4187-ac68-68d8a60b4cc4 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:29.003488 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-44fe2fdd-0d62-4187-ac68-68d8a60b4cc4 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:29.010956 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-44fe2fdd-0d62-4187-ac68-68d8a60b4cc4 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:29.011403 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-44fe2fdd-0d62-4187-ac68-68d8a60b4cc4 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:29.012443 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-44fe2fdd-0d62-4187-ac68-68d8a60b4cc4 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:29.012878 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-44fe2fdd-0d62-4187-ac68-68d8a60b4cc4 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:29.152019 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-44fe2fdd-0d62-4187-ac68-68d8a60b4cc4 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:29.159560 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-44fe2fdd-0d62-4187-ac68-68d8a60b4cc4 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1577 microversion: 2.1 time: 0.161716 Jul 12 14:48:29.160120 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 500/1001] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:28 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:29.376984 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-435abf24-f620-4c09-9c33-a8543ff6ec18 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:29.377625 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-435abf24-f620-4c09-9c33-a8543ff6ec18 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 042348db-3a7f-47c5-8d26-336846b56bf1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:29.385025 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-435abf24-f620-4c09-9c33-a8543ff6ec18 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:29.385519 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-435abf24-f620-4c09-9c33-a8543ff6ec18 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:29.386280 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-435abf24-f620-4c09-9c33-a8543ff6ec18 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:29.386716 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-435abf24-f620-4c09-9c33-a8543ff6ec18 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:29.515072 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-435abf24-f620-4c09-9c33-a8543ff6ec18 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:29.522549 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-435abf24-f620-4c09-9c33-a8543ff6ec18 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1" status: 200 len: 1515 microversion: 2.1 time: 0.149420 Jul 12 14:48:29.523110 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 502/1002] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:29 2022] GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:30.177381 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-9319a387-de97-4e53-918e-05052e646ba9 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:30.177995 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-9319a387-de97-4e53-918e-05052e646ba9 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:30.185532 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9319a387-de97-4e53-918e-05052e646ba9 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:30.185988 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9319a387-de97-4e53-918e-05052e646ba9 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:30.186766 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9319a387-de97-4e53-918e-05052e646ba9 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:30.187207 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9319a387-de97-4e53-918e-05052e646ba9 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:30.540723 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-b4bb6aee-f6aa-47df-86e4-83438d50023c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:30.541370 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-b4bb6aee-f6aa-47df-86e4-83438d50023c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 042348db-3a7f-47c5-8d26-336846b56bf1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:30.549616 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b4bb6aee-f6aa-47df-86e4-83438d50023c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:30.550858 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b4bb6aee-f6aa-47df-86e4-83438d50023c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:30.553290 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b4bb6aee-f6aa-47df-86e4-83438d50023c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:30.553833 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b4bb6aee-f6aa-47df-86e4-83438d50023c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:30.642711 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-b4bb6aee-f6aa-47df-86e4-83438d50023c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:30.650968 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-b4bb6aee-f6aa-47df-86e4-83438d50023c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1" status: 200 len: 1473 microversion: 2.1 time: 0.114815 Jul 12 14:48:30.651666 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 503/1003] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:30 2022] GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1 => generated 1473 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:30.656324 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-82ac34c9-903f-482c-a42d-e4557df48bfc req-ec13d1d5-07ef-433f-81f5-123431d1c515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "042348db-3a7f-47c5-8d26-336846b56bf1", "name": "network-vif-deleted", "tag": "fefcfef8-6a7e-4939-8324-f3f2f622a338"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:48:30.664418 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-82ac34c9-903f-482c-a42d-e4557df48bfc req-ec13d1d5-07ef-433f-81f5-123431d1c515 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:30.665491 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-82ac34c9-903f-482c-a42d-e4557df48bfc req-ec13d1d5-07ef-433f-81f5-123431d1c515 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:30.679290 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-82ac34c9-903f-482c-a42d-e4557df48bfc req-ec13d1d5-07ef-433f-81f5-123431d1c515 service nova] Creating event network-vif-deleted:fefcfef8-6a7e-4939-8324-f3f2f622a338 for instance 042348db-3a7f-47c5-8d26-336846b56bf1 on hv-cinder-82002 Jul 12 14:48:30.684448 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-82ac34c9-903f-482c-a42d-e4557df48bfc req-ec13d1d5-07ef-433f-81f5-123431d1c515 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031425 Jul 12 14:48:30.684992 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 504/1004] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:48:30.697652 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-9319a387-de97-4e53-918e-05052e646ba9 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:30.704974 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-9319a387-de97-4e53-918e-05052e646ba9 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1517 microversion: 2.1 time: 0.531590 Jul 12 14:48:30.705591 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 501/1005] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:30 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1517 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:31.668890 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-ff83c3cd-9d74-440d-9cd7-6eaccf4a42f0 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:31.669873 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-ff83c3cd-9d74-440d-9cd7-6eaccf4a42f0 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 042348db-3a7f-47c5-8d26-336846b56bf1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:31.676277 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ff83c3cd-9d74-440d-9cd7-6eaccf4a42f0 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:31.676717 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ff83c3cd-9d74-440d-9cd7-6eaccf4a42f0 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:31.677506 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ff83c3cd-9d74-440d-9cd7-6eaccf4a42f0 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:31.678033 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ff83c3cd-9d74-440d-9cd7-6eaccf4a42f0 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:31.715351 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ff83c3cd-9d74-440d-9cd7-6eaccf4a42f0 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:31.715855 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ff83c3cd-9d74-440d-9cd7-6eaccf4a42f0 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:31.716440 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.objects.instance [None req-ff83c3cd-9d74-440d-9cd7-6eaccf4a42f0 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lazy-loading 'fault' on Instance uuid 042348db-3a7f-47c5-8d26-336846b56bf1 {{(pid=129981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:48:31.723357 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-81fd49df-6a29-40d1-b8e6-df2b360d1236 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:31.724090 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-81fd49df-6a29-40d1-b8e6-df2b360d1236 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:31.726699 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:48:31.731661 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-81fd49df-6a29-40d1-b8e6-df2b360d1236 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:31.732116 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-81fd49df-6a29-40d1-b8e6-df2b360d1236 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:31.732898 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-81fd49df-6a29-40d1-b8e6-df2b360d1236 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:31.733439 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-81fd49df-6a29-40d1-b8e6-df2b360d1236 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:31.765423 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-ff83c3cd-9d74-440d-9cd7-6eaccf4a42f0 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:31.773339 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-ff83c3cd-9d74-440d-9cd7-6eaccf4a42f0 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1" status: 200 len: 1309 microversion: 2.1 time: 0.109215 Jul 12 14:48:31.773911 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 505/1006] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:31 2022] GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1 => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:31.869977 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-81fd49df-6a29-40d1-b8e6-df2b360d1236 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:31.877489 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-81fd49df-6a29-40d1-b8e6-df2b360d1236 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1519 microversion: 2.1 time: 0.158083 Jul 12 14:48:31.879776 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 502/1007] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:31 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:48:32.792015 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-f82f8842-6037-4990-b5b5-3c095cedbe82 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:32.792605 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-f82f8842-6037-4990-b5b5-3c095cedbe82 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 042348db-3a7f-47c5-8d26-336846b56bf1] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:32.798562 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f82f8842-6037-4990-b5b5-3c095cedbe82 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:32.799006 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f82f8842-6037-4990-b5b5-3c095cedbe82 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:32.799752 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f82f8842-6037-4990-b5b5-3c095cedbe82 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:32.800191 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-f82f8842-6037-4990-b5b5-3c095cedbe82 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:32.813288 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.wsgi [None req-f82f8842-6037-4990-b5b5-3c095cedbe82 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] HTTP exception thrown: Instance 042348db-3a7f-47c5-8d26-336846b56bf1 could not be found. Jul 12 14:48:32.814899 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-f82f8842-6037-4990-b5b5-3c095cedbe82 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Request method failure captured: Jul 12 14:48:32.814899 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1 HTTP/1.1 Jul 12 14:48:32.814899 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:48:32.814899 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:48:32.814899 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:48:32.814899 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 0 Jul 12 14:48:32.814899 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:48:32.814899 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:48:32.814899 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:48:32.814899 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:48:32.814899 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYlyqxhjCG00wqhXs2ZqIJlvT-WrSNz3APuR7teNrDg9nTAuMLa463GgaKhYcdsrFQq492L4JBqoD6yptqNmNMsOUlHPOKEdUZY4iXCiqsCGs9-RrlER2SDr9PsgWR6Czhx6D54k1Ku9BtSXyRvQ_iJUKtYiMFYQOJ6-mo--QikJRs8 Jul 12 14:48:32.814899 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:48:32.814899 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:48:32.814899 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:48:32.814899 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:48:32.814899 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:48:32.814899 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:48:32.814899 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: e89c4c765f5243eaa314231429d20598 Jul 12 14:48:32.814899 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1496703537 Jul 12 14:48:32.814899 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:48:32.814899 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:48:32.816600 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e89c4c765f5243eaa314231429d20598"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e89c4c765f5243eaa314231429d20598"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e89c4c765f5243eaa314231429d20598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e89c4c765f5243eaa314231429d20598", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:48:32.816600 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-VolumesSnapshotTestJSON-1496703537 Jul 12 14:48:32.816600 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: e89c4c765f5243eaa314231429d20598 Jul 12 14:48:32.816600 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1496703537 Jul 12 14:48:32.816600 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-VolumesSnapshotTestJSON-1496703537-project Jul 12 14:48:32.816600 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:48:32.816600 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:48:32.816600 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: 2b123a78349c4daba0502a4e9e98245f Jul 12 14:48:32.816600 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-VolumesSnapshotTestJSON-1496703537-project Jul 12 14:48:32.816600 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: > Jul 12 14:48:32.816600 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Instance 042348db-3a7f-47c5-8d26-336846b56bf1 could not be found. Jul 12 14:48:32.816600 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'id': '042348db-3a7f-47c5-8d26-336846b56bf1'} Jul 12 14:48:32.817825 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:48:32.817825 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:48:32.817825 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:48:32.817825 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:48:32.817825 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:48:32.817825 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:48:32.817825 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:48:32.817825 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:48:32.817825 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:48:32.817825 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:48:32.817825 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 042348db-3a7f-47c5-8d26-336846b56bf1 could not be found. Jul 12 14:48:32.817825 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:48:32.817825 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:48:32.817825 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:48:32.817825 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:48:32.817825 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:48:32.817825 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:48:32.817825 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:48:32.817825 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:48:32.817825 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:48:32.819455 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:48:32.819455 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:48:32.819455 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:48:32.819455 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:48:32.819455 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:48:32.819455 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:48:32.819455 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:48:32.819455 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 042348db-3a7f-47c5-8d26-336846b56bf1 could not be found. Jul 12 14:48:32.819455 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:48:32.819455 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:48:32.819455 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:48:32.819455 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:48:32.819455 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:48:32.819455 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:48:32.819455 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:48:32.819455 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:48:32.819455 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 042348db-3a7f-47c5-8d26-336846b56bf1 could not be found. Jul 12 14:48:32.819455 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:48:32.820798 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-f82f8842-6037-4990-b5b5-3c095cedbe82 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Returning 404 to user: Instance 042348db-3a7f-47c5-8d26-336846b56bf1 could not be found. {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:48:32.820798 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-f82f8842-6037-4990-b5b5-3c095cedbe82 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1" status: 404 len: 111 microversion: 2.1 time: 0.029015 Jul 12 14:48:32.820798 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 506/1008] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:32 2022] GET /compute/v2.1/servers/042348db-3a7f-47c5-8d26-336846b56bf1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 14:48:32.895837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-50e21748-c1a0-4a23-9c18-723c14f9585f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:32.896459 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-50e21748-c1a0-4a23-9c18-723c14f9585f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:32.904364 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-50e21748-c1a0-4a23-9c18-723c14f9585f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:32.906656 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-50e21748-c1a0-4a23-9c18-723c14f9585f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:32.906656 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-50e21748-c1a0-4a23-9c18-723c14f9585f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:32.906656 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-50e21748-c1a0-4a23-9c18-723c14f9585f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:33.038396 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-50e21748-c1a0-4a23-9c18-723c14f9585f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:33.046911 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-50e21748-c1a0-4a23-9c18-723c14f9585f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1575 microversion: 2.1 time: 0.154934 Jul 12 14:48:33.047517 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 503/1009] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:32 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:34.063823 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-56fe1877-e96c-4e3a-9f5d-7a1daab7d44f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:34.064469 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-56fe1877-e96c-4e3a-9f5d-7a1daab7d44f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:34.071467 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-56fe1877-e96c-4e3a-9f5d-7a1daab7d44f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:34.071911 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-56fe1877-e96c-4e3a-9f5d-7a1daab7d44f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:34.072664 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-56fe1877-e96c-4e3a-9f5d-7a1daab7d44f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:34.073094 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-56fe1877-e96c-4e3a-9f5d-7a1daab7d44f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:34.207251 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-56fe1877-e96c-4e3a-9f5d-7a1daab7d44f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:34.215431 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-56fe1877-e96c-4e3a-9f5d-7a1daab7d44f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1575 microversion: 2.1 time: 0.155609 Jul 12 14:48:34.215991 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 507/1010] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:34 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:35.038120 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-c2afd71a-21f2-4243-9913-61c130055b6a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:35.038712 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-c2afd71a-21f2-4243-9913-61c130055b6a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:35.045264 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c2afd71a-21f2-4243-9913-61c130055b6a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:35.045718 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c2afd71a-21f2-4243-9913-61c130055b6a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:35.046484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c2afd71a-21f2-4243-9913-61c130055b6a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:35.046920 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c2afd71a-21f2-4243-9913-61c130055b6a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:35.070574 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-c2afd71a-21f2-4243-9913-61c130055b6a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e/ips" status: 200 len: 149 microversion: 2.1 time: 0.036298 Jul 12 14:48:35.077195 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 504/1011] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Jul 12 14:48:35 2022] GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:48:35.234522 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-bec6b674-6da0-45bc-993b-1ab28c7387c3 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:35.235157 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-bec6b674-6da0-45bc-993b-1ab28c7387c3 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:35.241773 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bec6b674-6da0-45bc-993b-1ab28c7387c3 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:35.242221 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bec6b674-6da0-45bc-993b-1ab28c7387c3 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:35.243501 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bec6b674-6da0-45bc-993b-1ab28c7387c3 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:35.243929 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-bec6b674-6da0-45bc-993b-1ab28c7387c3 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:35.377081 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-bec6b674-6da0-45bc-993b-1ab28c7387c3 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:35.388636 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-bec6b674-6da0-45bc-993b-1ab28c7387c3 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1575 microversion: 2.1 time: 0.159878 Jul 12 14:48:35.391757 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 508/1012] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:35 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:36.406194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-5a9bef91-ef5e-4db4-b124-0cf188267a46 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:36.406817 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-5a9bef91-ef5e-4db4-b124-0cf188267a46 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:36.413484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5a9bef91-ef5e-4db4-b124-0cf188267a46 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:36.413939 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5a9bef91-ef5e-4db4-b124-0cf188267a46 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:36.414733 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5a9bef91-ef5e-4db4-b124-0cf188267a46 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:36.415174 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5a9bef91-ef5e-4db4-b124-0cf188267a46 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:36.547270 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-5a9bef91-ef5e-4db4-b124-0cf188267a46 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:36.554921 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-5a9bef91-ef5e-4db4-b124-0cf188267a46 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1575 microversion: 2.1 time: 0.152659 Jul 12 14:48:36.556018 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 505/1013] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:36 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:37.571878 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-223ab23c-668a-4233-92ca-a4fb15cd6546 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:37.572520 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-223ab23c-668a-4233-92ca-a4fb15cd6546 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:37.578950 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-223ab23c-668a-4233-92ca-a4fb15cd6546 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:37.579395 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-223ab23c-668a-4233-92ca-a4fb15cd6546 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:37.580153 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-223ab23c-668a-4233-92ca-a4fb15cd6546 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:37.580582 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-223ab23c-668a-4233-92ca-a4fb15cd6546 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:37.718453 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-223ab23c-668a-4233-92ca-a4fb15cd6546 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:37.726052 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-223ab23c-668a-4233-92ca-a4fb15cd6546 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1575 microversion: 2.1 time: 0.158027 Jul 12 14:48:37.731500 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 509/1014] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:37 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:37.879556 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-b2cb0f61-fac7-48c1-96e8-d35b7f483996 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf26a4e7-7ae1-4293-995c-18d979dae53f"}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:48:37.880623 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-b2cb0f61-fac7-48c1-96e8-d35b7f483996 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:37.887792 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b2cb0f61-fac7-48c1-96e8-d35b7f483996 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:37.888263 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b2cb0f61-fac7-48c1-96e8-d35b7f483996 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:37.889027 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b2cb0f61-fac7-48c1-96e8-d35b7f483996 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:37.889510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b2cb0f61-fac7-48c1-96e8-d35b7f483996 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:38.656348 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-b2cb0f61-fac7-48c1-96e8-d35b7f483996 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "POST /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.780916 Jul 12 14:48:38.657231 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 506/1015] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Jul 12 14:48:37 2022] POST /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e/os-volume_attachments => generated 194 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:48:38.747246 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-dcb1d1b4-43ad-4056-ac3d-0fb4c65a81af tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:38.747855 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-dcb1d1b4-43ad-4056-ac3d-0fb4c65a81af tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:38.755409 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-dcb1d1b4-43ad-4056-ac3d-0fb4c65a81af tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:38.758911 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-dcb1d1b4-43ad-4056-ac3d-0fb4c65a81af tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:38.758911 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-dcb1d1b4-43ad-4056-ac3d-0fb4c65a81af tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:38.758911 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-dcb1d1b4-43ad-4056-ac3d-0fb4c65a81af tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:38.897591 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-dcb1d1b4-43ad-4056-ac3d-0fb4c65a81af tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:38.906368 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-dcb1d1b4-43ad-4056-ac3d-0fb4c65a81af tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1575 microversion: 2.1 time: 0.163385 Jul 12 14:48:38.907399 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 510/1016] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:38 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:39.924294 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-b6b76fbb-43a8-4da2-8a92-a56d0e4ed46f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:39.924984 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-b6b76fbb-43a8-4da2-8a92-a56d0e4ed46f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:39.931731 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b6b76fbb-43a8-4da2-8a92-a56d0e4ed46f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:39.932180 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b6b76fbb-43a8-4da2-8a92-a56d0e4ed46f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:39.932932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b6b76fbb-43a8-4da2-8a92-a56d0e4ed46f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:39.933398 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b6b76fbb-43a8-4da2-8a92-a56d0e4ed46f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:40.067770 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-b6b76fbb-43a8-4da2-8a92-a56d0e4ed46f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:40.075972 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-b6b76fbb-43a8-4da2-8a92-a56d0e4ed46f tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1575 microversion: 2.1 time: 0.155940 Jul 12 14:48:40.076553 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 507/1017] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:39 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:41.095017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-43262696-f441-47bb-8772-d51a4012aa0d tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:41.095564 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-43262696-f441-47bb-8772-d51a4012aa0d tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:41.102169 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-43262696-f441-47bb-8772-d51a4012aa0d tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:41.102623 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-43262696-f441-47bb-8772-d51a4012aa0d tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:41.103381 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-43262696-f441-47bb-8772-d51a4012aa0d tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:41.103821 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-43262696-f441-47bb-8772-d51a4012aa0d tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:41.239995 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-43262696-f441-47bb-8772-d51a4012aa0d tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:41.248445 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-43262696-f441-47bb-8772-d51a4012aa0d tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1575 microversion: 2.1 time: 0.157473 Jul 12 14:48:41.249003 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 511/1018] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:41 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:42.266072 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-85983598-e67d-455f-86fb-ff9c9cedbcbd tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:42.266676 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-85983598-e67d-455f-86fb-ff9c9cedbcbd tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:42.273131 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-85983598-e67d-455f-86fb-ff9c9cedbcbd tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:42.273609 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-85983598-e67d-455f-86fb-ff9c9cedbcbd tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:42.274360 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-85983598-e67d-455f-86fb-ff9c9cedbcbd tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:42.275464 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-85983598-e67d-455f-86fb-ff9c9cedbcbd tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:42.404346 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-85983598-e67d-455f-86fb-ff9c9cedbcbd tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:42.412126 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-85983598-e67d-455f-86fb-ff9c9cedbcbd tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1575 microversion: 2.1 time: 0.149946 Jul 12 14:48:42.412788 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 508/1019] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:42 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:43.324618 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-800237e4-27ac-4f88-bde3-ad25d506aad7 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1087606290", "imageRef": "a66ccacb-7b1e-4f51-9eaf-069a356e0fdb", "flavorRef": "452", "networks": [{"uuid": "42dafc72-b3d0-4625-899c-fa87da784304"}]}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:48:43.376738 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.network.neutron [None req-800237e4-27ac-4f88-bde3-ad25d506aad7 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] validate_networks() for [('42dafc72-b3d0-4625-899c-fa87da784304', None, None, None, None, None)] {{(pid=129981) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:48:43.429561 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-c38f3548-fcf6-4b0f-8544-75d30caba353 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:43.430140 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-c38f3548-fcf6-4b0f-8544-75d30caba353 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:43.437385 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c38f3548-fcf6-4b0f-8544-75d30caba353 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:43.437851 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c38f3548-fcf6-4b0f-8544-75d30caba353 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:43.438730 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c38f3548-fcf6-4b0f-8544-75d30caba353 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:43.439184 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-c38f3548-fcf6-4b0f-8544-75d30caba353 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:43.643818 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-c38f3548-fcf6-4b0f-8544-75d30caba353 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:43.651319 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-c38f3548-fcf6-4b0f-8544-75d30caba353 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1575 microversion: 2.1 time: 0.225685 Jul 12 14:48:43.651886 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 509/1020] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:43 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1575 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:48:43.798440 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-800237e4-27ac-4f88-bde3-ad25d506aad7 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Flavor limits 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:48:43.798842 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-800237e4-27ac-4f88-bde3-ad25d506aad7 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Image limits 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:48:43.799309 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-800237e4-27ac-4f88-bde3-ad25d506aad7 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Flavor pref 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:48:43.799711 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-800237e4-27ac-4f88-bde3-ad25d506aad7 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Image pref 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:48:43.800120 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-800237e4-27ac-4f88-bde3-ad25d506aad7 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:48:43.809743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-800237e4-27ac-4f88-bde3-ad25d506aad7 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:43.810434 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-800237e4-27ac-4f88-bde3-ad25d506aad7 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:43.811237 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-800237e4-27ac-4f88-bde3-ad25d506aad7 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:43.811676 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-800237e4-27ac-4f88-bde3-ad25d506aad7 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:43.828796 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.quota [None req-800237e4-27ac-4f88-bde3-ad25d506aad7 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Getting quotas for project e89c4c765f5243eaa314231429d20598. Resources: {'instances', 'cores', 'ram'} {{(pid=129981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:48:43.832800 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.quota [None req-800237e4-27ac-4f88-bde3-ad25d506aad7 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Getting quotas for user 2b123a78349c4daba0502a4e9e98245f and project e89c4c765f5243eaa314231429d20598. Resources: {'instances', 'cores', 'ram'} {{(pid=129981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:48:43.843739 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-800237e4-27ac-4f88-bde3-ad25d506aad7 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Going to run 1 instances... {{(pid=129981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:48:43.846047 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-800237e4-27ac-4f88-bde3-ad25d506aad7 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a66ccacb-7b1e-4f51-9eaf-069a356e0fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:48:43.999882 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-800237e4-27ac-4f88-bde3-ad25d506aad7 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.679559 Jul 12 14:48:44.000528 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 512/1021] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Jul 12 14:48:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:48:44.011209 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-8e3889c6-2fe1-4e55-a126-99db3e3838b9 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:44.011814 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-8e3889c6-2fe1-4e55-a126-99db3e3838b9 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:44.070961 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-8e3889c6-2fe1-4e55-a126-99db3e3838b9 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:44.078068 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-8e3889c6-2fe1-4e55-a126-99db3e3838b9 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a" status: 200 len: 1219 microversion: 2.1 time: 0.070228 Jul 12 14:48:44.078674 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 510/1022] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:44 2022] GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:48:44.668709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-91d41359-67eb-4e00-bbc5-1746e208d94c tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:44.669376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-91d41359-67eb-4e00-bbc5-1746e208d94c tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:44.675511 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-91d41359-67eb-4e00-bbc5-1746e208d94c tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:44.675955 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-91d41359-67eb-4e00-bbc5-1746e208d94c tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:44.676716 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-91d41359-67eb-4e00-bbc5-1746e208d94c tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:44.677170 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-91d41359-67eb-4e00-bbc5-1746e208d94c tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:44.809135 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-91d41359-67eb-4e00-bbc5-1746e208d94c tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:44.816637 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-91d41359-67eb-4e00-bbc5-1746e208d94c tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1575 microversion: 2.1 time: 0.152312 Jul 12 14:48:44.817219 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 513/1023] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:44 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:45.094708 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-a9cc917e-d773-4229-ab2e-acab9ffc31b6 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:45.095269 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-a9cc917e-d773-4229-ab2e-acab9ffc31b6 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:45.102377 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a9cc917e-d773-4229-ab2e-acab9ffc31b6 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:45.102827 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a9cc917e-d773-4229-ab2e-acab9ffc31b6 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:45.103589 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a9cc917e-d773-4229-ab2e-acab9ffc31b6 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:45.104026 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a9cc917e-d773-4229-ab2e-acab9ffc31b6 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:45.164036 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-a9cc917e-d773-4229-ab2e-acab9ffc31b6 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:45.171409 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-a9cc917e-d773-4229-ab2e-acab9ffc31b6 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a" status: 200 len: 1223 microversion: 2.1 time: 0.080641 Jul 12 14:48:45.171974 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 511/1024] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:45 2022] GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:45.834367 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-66fcb211-8780-449e-9b3d-30324d5ecfed tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:45.834962 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-66fcb211-8780-449e-9b3d-30324d5ecfed tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:45.841638 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-5517fd72-56f2-445e-b708-131405a528e3 req-6962af6a-299f-4e7c-9438-7d2bf9398dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "336f3e15-d106-4a54-b655-49328b81248d", "name": "network-vif-plugged", "status": "completed", "tag": "07cdb948-262b-44e3-a60e-ac8f1916b818"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:48:45.842991 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-66fcb211-8780-449e-9b3d-30324d5ecfed tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:45.843996 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-66fcb211-8780-449e-9b3d-30324d5ecfed tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:45.844225 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-66fcb211-8780-449e-9b3d-30324d5ecfed tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:45.844666 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-66fcb211-8780-449e-9b3d-30324d5ecfed tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:45.852817 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-5517fd72-56f2-445e-b708-131405a528e3 req-6962af6a-299f-4e7c-9438-7d2bf9398dd6 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:45.853289 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-5517fd72-56f2-445e-b708-131405a528e3 req-6962af6a-299f-4e7c-9438-7d2bf9398dd6 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:45.884679 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-5517fd72-56f2-445e-b708-131405a528e3 req-6962af6a-299f-4e7c-9438-7d2bf9398dd6 service nova] Creating event network-vif-plugged:07cdb948-262b-44e3-a60e-ac8f1916b818 for instance 336f3e15-d106-4a54-b655-49328b81248d on hv-cinder-82002 Jul 12 14:48:45.892237 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-5517fd72-56f2-445e-b708-131405a528e3 req-6962af6a-299f-4e7c-9438-7d2bf9398dd6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055027 Jul 12 14:48:45.892774 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 512/1025] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:48:45.986193 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-66fcb211-8780-449e-9b3d-30324d5ecfed tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:45.993812 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-66fcb211-8780-449e-9b3d-30324d5ecfed tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1575 microversion: 2.1 time: 0.163301 Jul 12 14:48:45.994384 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 514/1026] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:45 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:46.189133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-280d2552-74d0-4ddb-98cf-0ee52186df27 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:46.189889 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-280d2552-74d0-4ddb-98cf-0ee52186df27 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:46.198755 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-280d2552-74d0-4ddb-98cf-0ee52186df27 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:46.199720 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-280d2552-74d0-4ddb-98cf-0ee52186df27 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:46.200676 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-280d2552-74d0-4ddb-98cf-0ee52186df27 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:46.201460 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-280d2552-74d0-4ddb-98cf-0ee52186df27 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:46.283033 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-280d2552-74d0-4ddb-98cf-0ee52186df27 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:46.293654 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-280d2552-74d0-4ddb-98cf-0ee52186df27 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a" status: 200 len: 1279 microversion: 2.1 time: 0.109298 Jul 12 14:48:46.294601 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 513/1027] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:46 2022] GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a => generated 1279 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:47.010776 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-370ea4f3-3c55-4305-9277-168a8863fcad tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:47.011812 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-370ea4f3-3c55-4305-9277-168a8863fcad tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:47.018459 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-370ea4f3-3c55-4305-9277-168a8863fcad tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:47.018908 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-370ea4f3-3c55-4305-9277-168a8863fcad tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:47.019699 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-370ea4f3-3c55-4305-9277-168a8863fcad tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:47.020139 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-370ea4f3-3c55-4305-9277-168a8863fcad tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:47.037180 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:48:47.159223 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-370ea4f3-3c55-4305-9277-168a8863fcad tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:47.167157 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-370ea4f3-3c55-4305-9277-168a8863fcad tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1575 microversion: 2.1 time: 0.160361 Jul 12 14:48:47.167719 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 515/1028] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:47 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:47.314814 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-05e9830c-b77e-48e1-b58e-6b7fc700546a tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:47.315663 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-05e9830c-b77e-48e1-b58e-6b7fc700546a tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:47.322692 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-05e9830c-b77e-48e1-b58e-6b7fc700546a tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:47.328768 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-05e9830c-b77e-48e1-b58e-6b7fc700546a tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:47.328768 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-05e9830c-b77e-48e1-b58e-6b7fc700546a tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:47.328768 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-05e9830c-b77e-48e1-b58e-6b7fc700546a tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:47.328768 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:48:47.536776 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-05e9830c-b77e-48e1-b58e-6b7fc700546a tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:47.545394 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-05e9830c-b77e-48e1-b58e-6b7fc700546a tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a" status: 200 len: 1319 microversion: 2.1 time: 0.234388 Jul 12 14:48:47.546245 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 514/1029] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:47 2022] GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:48.072348 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-9a59efc3-6c83-4955-8e26-b3dbc8441f27 req-074b09d1-34d9-43ae-989c-d3a8f4fca930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "446a84da-7f55-4b8a-8b09-ffcc85cc3a0a", "tag": "2d1128ff-70e1-441b-8b0f-16f0a58b51f6"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:48:48.082379 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-9a59efc3-6c83-4955-8e26-b3dbc8441f27 req-074b09d1-34d9-43ae-989c-d3a8f4fca930 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:48.082837 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-9a59efc3-6c83-4955-8e26-b3dbc8441f27 req-074b09d1-34d9-43ae-989c-d3a8f4fca930 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:48.100982 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-9a59efc3-6c83-4955-8e26-b3dbc8441f27 req-074b09d1-34d9-43ae-989c-d3a8f4fca930 service nova] Creating event network-changed:2d1128ff-70e1-441b-8b0f-16f0a58b51f6 for instance 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a on hv-cinder-82002 Jul 12 14:48:48.106674 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-9a59efc3-6c83-4955-8e26-b3dbc8441f27 req-074b09d1-34d9-43ae-989c-d3a8f4fca930 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038924 Jul 12 14:48:48.107542 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 516/1030] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:48:48.186995 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-23ab6aa4-463f-4adf-b5c6-82fc56994224 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:48.187631 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-23ab6aa4-463f-4adf-b5c6-82fc56994224 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:48.209462 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-23ab6aa4-463f-4adf-b5c6-82fc56994224 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:48.211939 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-23ab6aa4-463f-4adf-b5c6-82fc56994224 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:48.213351 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-23ab6aa4-463f-4adf-b5c6-82fc56994224 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:48.213795 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-23ab6aa4-463f-4adf-b5c6-82fc56994224 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:48.407012 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-23ab6aa4-463f-4adf-b5c6-82fc56994224 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:48.414652 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-23ab6aa4-463f-4adf-b5c6-82fc56994224 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1562 microversion: 2.1 time: 0.234043 Jul 12 14:48:48.415245 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 515/1031] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:48 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1562 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:48.563371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-3ab4ea06-d720-4a0d-bf43-360c7b0fd51a tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:48.564001 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-3ab4ea06-d720-4a0d-bf43-360c7b0fd51a tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:48.570426 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3ab4ea06-d720-4a0d-bf43-360c7b0fd51a tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:48.570880 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3ab4ea06-d720-4a0d-bf43-360c7b0fd51a tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:48.572259 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3ab4ea06-d720-4a0d-bf43-360c7b0fd51a tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:48.572701 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3ab4ea06-d720-4a0d-bf43-360c7b0fd51a tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:48.706481 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-3ab4ea06-d720-4a0d-bf43-360c7b0fd51a tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:48.713873 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-3ab4ea06-d720-4a0d-bf43-360c7b0fd51a tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a" status: 200 len: 1319 microversion: 2.1 time: 0.154755 Jul 12 14:48:48.714828 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 517/1032] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:48 2022] GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:49.730892 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-b6773fa9-bb3f-4f79-966b-103c186ef63b tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:49.731505 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-b6773fa9-bb3f-4f79-966b-103c186ef63b tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:49.738026 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b6773fa9-bb3f-4f79-966b-103c186ef63b tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:49.738479 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b6773fa9-bb3f-4f79-966b-103c186ef63b tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:49.739242 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b6773fa9-bb3f-4f79-966b-103c186ef63b tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:49.739681 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b6773fa9-bb3f-4f79-966b-103c186ef63b tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:49.868163 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-b6773fa9-bb3f-4f79-966b-103c186ef63b tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:49.875480 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-b6773fa9-bb3f-4f79-966b-103c186ef63b tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a" status: 200 len: 1319 microversion: 2.1 time: 0.148546 Jul 12 14:48:49.876050 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 516/1033] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:49 2022] GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:50.380556 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-f1577502-4434-4740-9c8d-9899858d2a03 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Action: 'create', calling method: .version_select at 0x7f962c816700>, body: {"keypair": {"name": "tempest-keypair-1511733818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhSzPCFHB250EWLPMdhhRbhTdnhEtTXplYFudxc2EvTaCJektHxnStc/e+jFaXhKG0W8kP43RwnVlMLDgxpWbAY/htXyUJ+0QgC55Ek5QAw6ON6SQIpsO5FmVfyBqhd9A=="}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:48:50.395603 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.quota [None req-f1577502-4434-4740-9c8d-9899858d2a03 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Getting quotas for project 35438fec2e37438e99201870e0d650af. Resources: {'key_pairs'} {{(pid=129981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:48:50.399509 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.quota [None req-f1577502-4434-4740-9c8d-9899858d2a03 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Getting quotas for user f926d674e2dc4eb58d7fe6379b79310b and project 35438fec2e37438e99201870e0d650af. Resources: {'key_pairs'} {{(pid=129981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:48:50.515075 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-f1577502-4434-4740-9c8d-9899858d2a03 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.138393 Jul 12 14:48:50.515795 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 518/1034] 10.222.0.30 () {60 vars in 1158 bytes} [Tue Jul 12 14:48:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:48:50.892907 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-476914ff-1eb7-41f0-9b2d-4f750664d2ca tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:50.893985 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-476914ff-1eb7-41f0-9b2d-4f750664d2ca tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:50.902176 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-476914ff-1eb7-41f0-9b2d-4f750664d2ca tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:50.903096 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-476914ff-1eb7-41f0-9b2d-4f750664d2ca tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:50.907861 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-476914ff-1eb7-41f0-9b2d-4f750664d2ca tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:50.907861 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-476914ff-1eb7-41f0-9b2d-4f750664d2ca tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:51.035015 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-476914ff-1eb7-41f0-9b2d-4f750664d2ca tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:51.042973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-476914ff-1eb7-41f0-9b2d-4f750664d2ca tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a" status: 200 len: 1319 microversion: 2.1 time: 0.154126 Jul 12 14:48:51.045908 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 517/1035] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:50 2022] GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:52.060276 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c3d57735-3a76-40b5-90eb-a7ba6f4f265f tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:52.067238 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-c3d57735-3a76-40b5-90eb-a7ba6f4f265f tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:52.068207 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c3d57735-3a76-40b5-90eb-a7ba6f4f265f tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:52.069307 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c3d57735-3a76-40b5-90eb-a7ba6f4f265f tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:52.070080 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c3d57735-3a76-40b5-90eb-a7ba6f4f265f tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:52.070517 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c3d57735-3a76-40b5-90eb-a7ba6f4f265f tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:52.221751 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c3d57735-3a76-40b5-90eb-a7ba6f4f265f tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:52.230381 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-c3d57735-3a76-40b5-90eb-a7ba6f4f265f tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a" status: 200 len: 1319 microversion: 2.1 time: 0.174226 Jul 12 14:48:52.231077 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 519/1036] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:52 2022] GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:52.770502 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-87dbd0df-0b63-4c3d-a93c-5f1b3a3407be tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1774597321", "imageRef": "a66ccacb-7b1e-4f51-9eaf-069a356e0fdb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18dbd310-dea2-4429-9ee9-f4f77e3d7b99"}], "security_groups": [{"name": "tempest-securitygroup--971005698"}], "key_name": "tempest-keypair-1511733818", "user_data": "}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:48:52.871636 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.network.neutron [None req-87dbd0df-0b63-4c3d-a93c-5f1b3a3407be tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] validate_networks() for [('18dbd310-dea2-4429-9ee9-f4f77e3d7b99', None, None, None, None, None)] {{(pid=129980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:48:53.247994 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-5e268db5-500a-4311-a1bf-fe90fd9c6663 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:53.248659 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-5e268db5-500a-4311-a1bf-fe90fd9c6663 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:53.255730 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5e268db5-500a-4311-a1bf-fe90fd9c6663 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:53.256178 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5e268db5-500a-4311-a1bf-fe90fd9c6663 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:53.256933 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5e268db5-500a-4311-a1bf-fe90fd9c6663 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:53.257396 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5e268db5-500a-4311-a1bf-fe90fd9c6663 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:53.535144 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-87dbd0df-0b63-4c3d-a93c-5f1b3a3407be tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Flavor limits 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:48:53.535576 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-87dbd0df-0b63-4c3d-a93c-5f1b3a3407be tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Image limits 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:48:53.536062 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-87dbd0df-0b63-4c3d-a93c-5f1b3a3407be tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Flavor pref 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:48:53.536476 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-87dbd0df-0b63-4c3d-a93c-5f1b3a3407be tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Image pref 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:48:53.536893 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-87dbd0df-0b63-4c3d-a93c-5f1b3a3407be tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:48:53.545862 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-87dbd0df-0b63-4c3d-a93c-5f1b3a3407be tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:53.546319 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-87dbd0df-0b63-4c3d-a93c-5f1b3a3407be tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:53.547121 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-87dbd0df-0b63-4c3d-a93c-5f1b3a3407be tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:53.547566 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-87dbd0df-0b63-4c3d-a93c-5f1b3a3407be tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:53.564579 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-87dbd0df-0b63-4c3d-a93c-5f1b3a3407be tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Getting quotas for project 35438fec2e37438e99201870e0d650af. Resources: {'instances', 'cores', 'ram'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:48:53.568548 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-87dbd0df-0b63-4c3d-a93c-5f1b3a3407be tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Getting quotas for user f926d674e2dc4eb58d7fe6379b79310b and project 35438fec2e37438e99201870e0d650af. Resources: {'instances', 'cores', 'ram'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:48:53.580391 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-87dbd0df-0b63-4c3d-a93c-5f1b3a3407be tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Going to run 1 instances... {{(pid=129980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:48:53.581532 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-5e268db5-500a-4311-a1bf-fe90fd9c6663 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:53.582795 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-87dbd0df-0b63-4c3d-a93c-5f1b3a3407be tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a66ccacb-7b1e-4f51-9eaf-069a356e0fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:48:53.589699 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-5e268db5-500a-4311-a1bf-fe90fd9c6663 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a" status: 200 len: 1319 microversion: 2.1 time: 0.346106 Jul 12 14:48:53.590467 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 520/1037] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:53 2022] GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:48:53.713912 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-87dbd0df-0b63-4c3d-a93c-5f1b3a3407be tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.947700 Jul 12 14:48:53.714569 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 518/1038] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Jul 12 14:48:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:48:53.726046 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-97b0fd01-dc80-4db6-b9d0-468138aced47 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:53.726660 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-97b0fd01-dc80-4db6-b9d0-468138aced47 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:53.778797 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-97b0fd01-dc80-4db6-b9d0-468138aced47 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:53.785541 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-97b0fd01-dc80-4db6-b9d0-468138aced47 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627" status: 200 len: 1242 microversion: 2.1 time: 0.063289 Jul 12 14:48:53.786297 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 521/1039] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:53 2022] GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 => generated 1242 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:54.607263 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-e83b56ad-fab5-46d4-ba9b-78e1bcd84255 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:54.607912 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-e83b56ad-fab5-46d4-ba9b-78e1bcd84255 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:54.614817 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e83b56ad-fab5-46d4-ba9b-78e1bcd84255 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:54.615271 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e83b56ad-fab5-46d4-ba9b-78e1bcd84255 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:54.616038 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e83b56ad-fab5-46d4-ba9b-78e1bcd84255 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:54.616476 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e83b56ad-fab5-46d4-ba9b-78e1bcd84255 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:54.746549 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-e83b56ad-fab5-46d4-ba9b-78e1bcd84255 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:54.754361 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-e83b56ad-fab5-46d4-ba9b-78e1bcd84255 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a" status: 200 len: 1319 microversion: 2.1 time: 0.151745 Jul 12 14:48:54.754922 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 519/1040] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:54 2022] GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:54.802362 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-300ee031-2a9f-4e5a-b624-1c8df4d361d6 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:54.802974 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-300ee031-2a9f-4e5a-b624-1c8df4d361d6 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:54.804884 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell0:SELECT=2 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:48:54.811020 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-300ee031-2a9f-4e5a-b624-1c8df4d361d6 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:54.811470 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-300ee031-2a9f-4e5a-b624-1c8df4d361d6 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:54.812228 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-300ee031-2a9f-4e5a-b624-1c8df4d361d6 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:54.812664 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-300ee031-2a9f-4e5a-b624-1c8df4d361d6 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:54.872750 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-300ee031-2a9f-4e5a-b624-1c8df4d361d6 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:54.880437 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-300ee031-2a9f-4e5a-b624-1c8df4d361d6 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627" status: 200 len: 1246 microversion: 2.1 time: 0.081944 Jul 12 14:48:54.881028 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 522/1041] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:54 2022] GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:55.771160 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-2da64cbd-7450-44d4-b0c0-63c58630a6b3 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:55.771853 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-2da64cbd-7450-44d4-b0c0-63c58630a6b3 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:55.778618 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2da64cbd-7450-44d4-b0c0-63c58630a6b3 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:55.779065 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2da64cbd-7450-44d4-b0c0-63c58630a6b3 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:55.779823 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2da64cbd-7450-44d4-b0c0-63c58630a6b3 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:55.780259 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2da64cbd-7450-44d4-b0c0-63c58630a6b3 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:55.897033 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-abf3b9bb-c049-495a-aaa9-a16f7ff37d62 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:55.897637 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-abf3b9bb-c049-495a-aaa9-a16f7ff37d62 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:55.904904 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-abf3b9bb-c049-495a-aaa9-a16f7ff37d62 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:55.905443 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-abf3b9bb-c049-495a-aaa9-a16f7ff37d62 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:55.906502 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-abf3b9bb-c049-495a-aaa9-a16f7ff37d62 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:55.907109 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-abf3b9bb-c049-495a-aaa9-a16f7ff37d62 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:55.915446 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-2da64cbd-7450-44d4-b0c0-63c58630a6b3 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:55.924109 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-2da64cbd-7450-44d4-b0c0-63c58630a6b3 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a" status: 200 len: 1319 microversion: 2.1 time: 0.156741 Jul 12 14:48:55.924900 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 520/1042] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:55 2022] GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:55.984072 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-abf3b9bb-c049-495a-aaa9-a16f7ff37d62 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:55.992624 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-abf3b9bb-c049-495a-aaa9-a16f7ff37d62 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627" status: 200 len: 1238 microversion: 2.1 time: 0.099185 Jul 12 14:48:56.002943 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 523/1043] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:55 2022] GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 => generated 1238 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:56.172594 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-f4260ac4-0e38-43c3-a046-a75de6e2eef3 req-c528a8d8-c7be-4308-92f4-e54dc5d9b0d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "446a84da-7f55-4b8a-8b09-ffcc85cc3a0a", "name": "network-vif-plugged", "status": "completed", "tag": "2d1128ff-70e1-441b-8b0f-16f0a58b51f6"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:48:56.180837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-f4260ac4-0e38-43c3-a046-a75de6e2eef3 req-c528a8d8-c7be-4308-92f4-e54dc5d9b0d4 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:56.181328 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-f4260ac4-0e38-43c3-a046-a75de6e2eef3 req-c528a8d8-c7be-4308-92f4-e54dc5d9b0d4 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:56.192612 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-f4260ac4-0e38-43c3-a046-a75de6e2eef3 req-c528a8d8-c7be-4308-92f4-e54dc5d9b0d4 service nova] Creating event network-vif-plugged:2d1128ff-70e1-441b-8b0f-16f0a58b51f6 for instance 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a on hv-cinder-82002 Jul 12 14:48:56.198417 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-f4260ac4-0e38-43c3-a046-a75de6e2eef3 req-c528a8d8-c7be-4308-92f4-e54dc5d9b0d4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029340 Jul 12 14:48:56.199131 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 521/1044] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:48:56.941362 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e4d6414e-2a51-415a-ae1e-86f3baa58ea4 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:56.941977 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-e4d6414e-2a51-415a-ae1e-86f3baa58ea4 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:56.950296 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e4d6414e-2a51-415a-ae1e-86f3baa58ea4 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:56.952429 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e4d6414e-2a51-415a-ae1e-86f3baa58ea4 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:56.952429 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e4d6414e-2a51-415a-ae1e-86f3baa58ea4 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:56.952429 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e4d6414e-2a51-415a-ae1e-86f3baa58ea4 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:57.012402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-156d81d1-9e20-47f2-b077-5bb03abc8721 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:57.013103 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-156d81d1-9e20-47f2-b077-5bb03abc8721 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:57.021071 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-156d81d1-9e20-47f2-b077-5bb03abc8721 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:57.021580 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-156d81d1-9e20-47f2-b077-5bb03abc8721 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:57.027296 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-156d81d1-9e20-47f2-b077-5bb03abc8721 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:57.027296 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-156d81d1-9e20-47f2-b077-5bb03abc8721 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:57.140207 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-156d81d1-9e20-47f2-b077-5bb03abc8721 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:57.147902 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-156d81d1-9e20-47f2-b077-5bb03abc8721 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627" status: 200 len: 1302 microversion: 2.1 time: 0.140818 Jul 12 14:48:57.148490 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 522/1045] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:57 2022] GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 => generated 1302 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:48:57.209831 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e4d6414e-2a51-415a-ae1e-86f3baa58ea4 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:57.209831 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-e4d6414e-2a51-415a-ae1e-86f3baa58ea4 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a" status: 200 len: 1319 microversion: 2.1 time: 0.263939 Jul 12 14:48:57.209831 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 524/1046] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:56 2022] GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:58.165519 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-de1565df-aff3-4cac-a5b5-4c1007e3fbd2 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:58.166156 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-de1565df-aff3-4cac-a5b5-4c1007e3fbd2 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:58.172549 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-de1565df-aff3-4cac-a5b5-4c1007e3fbd2 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:58.173002 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-de1565df-aff3-4cac-a5b5-4c1007e3fbd2 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:58.173805 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-de1565df-aff3-4cac-a5b5-4c1007e3fbd2 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:58.174424 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-de1565df-aff3-4cac-a5b5-4c1007e3fbd2 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:58.219018 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-1dd14277-89e8-48ae-a00f-56c9ec5d81f2 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:58.219625 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-1dd14277-89e8-48ae-a00f-56c9ec5d81f2 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:58.222667 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:48:58.228023 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1dd14277-89e8-48ae-a00f-56c9ec5d81f2 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:58.230023 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1dd14277-89e8-48ae-a00f-56c9ec5d81f2 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:58.230023 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1dd14277-89e8-48ae-a00f-56c9ec5d81f2 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:58.230023 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1dd14277-89e8-48ae-a00f-56c9ec5d81f2 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:58.414785 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-de1565df-aff3-4cac-a5b5-4c1007e3fbd2 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:58.422827 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-de1565df-aff3-4cac-a5b5-4c1007e3fbd2 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627" status: 200 len: 1367 microversion: 2.1 time: 0.261412 Jul 12 14:48:58.423426 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 523/1047] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:58 2022] GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:58.477006 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-1dd14277-89e8-48ae-a00f-56c9ec5d81f2 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:58.484479 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-1dd14277-89e8-48ae-a00f-56c9ec5d81f2 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a" status: 200 len: 1319 microversion: 2.1 time: 0.269902 Jul 12 14:48:58.485088 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 525/1048] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:58 2022] GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:48:59.140198 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-69746e37-b883-44dc-8387-85f1405a98be req-707cb05d-4e7a-4d18-8e10-220560ce13ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4370218b-d99a-4484-829d-ffa09e867627", "tag": "fd4499b0-8818-4d57-aba9-bed0b1f2686e"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:48:59.167404 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-69746e37-b883-44dc-8387-85f1405a98be req-707cb05d-4e7a-4d18-8e10-220560ce13ba service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:59.168665 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-69746e37-b883-44dc-8387-85f1405a98be req-707cb05d-4e7a-4d18-8e10-220560ce13ba service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:59.180547 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-69746e37-b883-44dc-8387-85f1405a98be req-707cb05d-4e7a-4d18-8e10-220560ce13ba service nova] Creating event network-changed:fd4499b0-8818-4d57-aba9-bed0b1f2686e for instance 4370218b-d99a-4484-829d-ffa09e867627 on hv-cinder-82002 Jul 12 14:48:59.185665 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-69746e37-b883-44dc-8387-85f1405a98be req-707cb05d-4e7a-4d18-8e10-220560ce13ba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050473 Jul 12 14:48:59.186751 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 524/1049] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:48:59.445048 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-ecdf27ec-54ed-48e9-a2fe-4f7a12e58cae tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:59.445492 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-ecdf27ec-54ed-48e9-a2fe-4f7a12e58cae tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:59.452658 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ecdf27ec-54ed-48e9-a2fe-4f7a12e58cae tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:59.453109 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ecdf27ec-54ed-48e9-a2fe-4f7a12e58cae tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:59.456052 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ecdf27ec-54ed-48e9-a2fe-4f7a12e58cae tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:59.456052 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ecdf27ec-54ed-48e9-a2fe-4f7a12e58cae tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:59.502749 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-92d05ba9-792b-4ae3-aec7-f40f7360a254 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:48:59.507668 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-92d05ba9-792b-4ae3-aec7-f40f7360a254 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:59.513506 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-92d05ba9-792b-4ae3-aec7-f40f7360a254 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:59.513965 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-92d05ba9-792b-4ae3-aec7-f40f7360a254 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:59.514739 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-92d05ba9-792b-4ae3-aec7-f40f7360a254 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:59.515177 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-92d05ba9-792b-4ae3-aec7-f40f7360a254 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:59.694733 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-ecdf27ec-54ed-48e9-a2fe-4f7a12e58cae tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:59.702959 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-ecdf27ec-54ed-48e9-a2fe-4f7a12e58cae tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627" status: 200 len: 1367 microversion: 2.1 time: 0.266549 Jul 12 14:48:59.703554 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 526/1050] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:59 2022] GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:48:59.790559 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-92d05ba9-792b-4ae3-aec7-f40f7360a254 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:48:59.798195 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-92d05ba9-792b-4ae3-aec7-f40f7360a254 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a" status: 200 len: 1508 microversion: 2.1 time: 0.300124 Jul 12 14:48:59.798771 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 525/1051] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:48:59 2022] GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a => generated 1508 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:48:59.815593 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-2c84fc4e-67a9-4bf1-bb8d-bd723395c3ac tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f7cf3a7-4751-4f42-856c-cf26257c00b5", "device": "/dev/sdb"}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:48:59.816745 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-2c84fc4e-67a9-4bf1-bb8d-bd723395c3ac tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:48:59.823656 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2c84fc4e-67a9-4bf1-bb8d-bd723395c3ac tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:59.824114 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2c84fc4e-67a9-4bf1-bb8d-bd723395c3ac tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:48:59.824885 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2c84fc4e-67a9-4bf1-bb8d-bd723395c3ac tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:48:59.825356 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2c84fc4e-67a9-4bf1-bb8d-bd723395c3ac tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:00.709391 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-2c84fc4e-67a9-4bf1-bb8d-bd723395c3ac tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "POST /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.897490 Jul 12 14:49:00.710067 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 527/1052] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Jul 12 14:48:59 2022] POST /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a/os-volume_attachments => generated 194 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:49:00.724517 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-02f41eb9-20c2-4f88-86ab-b8530f8ab6e9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:00.724517 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-02f41eb9-20c2-4f88-86ab-b8530f8ab6e9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:00.727290 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-02f41eb9-20c2-4f88-86ab-b8530f8ab6e9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:00.727774 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-02f41eb9-20c2-4f88-86ab-b8530f8ab6e9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:00.728548 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-02f41eb9-20c2-4f88-86ab-b8530f8ab6e9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:00.728988 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-02f41eb9-20c2-4f88-86ab-b8530f8ab6e9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:00.860889 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-02f41eb9-20c2-4f88-86ab-b8530f8ab6e9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:00.868347 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-02f41eb9-20c2-4f88-86ab-b8530f8ab6e9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627" status: 200 len: 1367 microversion: 2.1 time: 0.152517 Jul 12 14:49:00.868912 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 526/1053] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:00 2022] GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:49:01.887200 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-2c18cefe-6200-4253-87ff-884efcc48d16 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:01.887978 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-2c18cefe-6200-4253-87ff-884efcc48d16 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:01.894323 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2c18cefe-6200-4253-87ff-884efcc48d16 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:01.894767 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2c18cefe-6200-4253-87ff-884efcc48d16 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:01.895520 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2c18cefe-6200-4253-87ff-884efcc48d16 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:01.895956 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2c18cefe-6200-4253-87ff-884efcc48d16 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:02.041398 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-2c18cefe-6200-4253-87ff-884efcc48d16 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:02.049180 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-2c18cefe-6200-4253-87ff-884efcc48d16 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627" status: 200 len: 1367 microversion: 2.1 time: 0.167084 Jul 12 14:49:02.050204 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 528/1054] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:01 2022] GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:03.069510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-cfc5331b-8146-4a60-b37f-185960627e99 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:03.070258 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-cfc5331b-8146-4a60-b37f-185960627e99 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:03.073285 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:03.078262 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-cfc5331b-8146-4a60-b37f-185960627e99 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:03.078767 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-cfc5331b-8146-4a60-b37f-185960627e99 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:03.079577 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-cfc5331b-8146-4a60-b37f-185960627e99 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:03.080054 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-cfc5331b-8146-4a60-b37f-185960627e99 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:03.208344 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-cfc5331b-8146-4a60-b37f-185960627e99 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:03.216563 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-cfc5331b-8146-4a60-b37f-185960627e99 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627" status: 200 len: 1367 microversion: 2.1 time: 0.153800 Jul 12 14:49:03.217127 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 527/1055] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:03 2022] GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:04.233947 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-7083f3c6-be5e-4ac6-b58e-dee53c80091b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:04.234577 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-7083f3c6-be5e-4ac6-b58e-dee53c80091b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:04.237085 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell0:SELECT=12 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:04.242045 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7083f3c6-be5e-4ac6-b58e-dee53c80091b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:04.242497 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7083f3c6-be5e-4ac6-b58e-dee53c80091b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:04.243281 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7083f3c6-be5e-4ac6-b58e-dee53c80091b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:04.243454 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-ca560d96-9b84-4a1b-ad62-3b74ac3c5c00 req-e1474c47-90f8-4d8f-ac84-ecca3252e9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4370218b-d99a-4484-829d-ffa09e867627", "name": "network-vif-plugged", "status": "completed", "tag": "fd4499b0-8818-4d57-aba9-bed0b1f2686e"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:49:04.243919 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7083f3c6-be5e-4ac6-b58e-dee53c80091b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:04.247022 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell0:SELECT=2 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:04.247845 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell0:SELECT=8 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:04.253778 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-ca560d96-9b84-4a1b-ad62-3b74ac3c5c00 req-e1474c47-90f8-4d8f-ac84-ecca3252e9a8 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:04.254403 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-ca560d96-9b84-4a1b-ad62-3b74ac3c5c00 req-e1474c47-90f8-4d8f-ac84-ecca3252e9a8 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:04.268165 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-ca560d96-9b84-4a1b-ad62-3b74ac3c5c00 req-e1474c47-90f8-4d8f-ac84-ecca3252e9a8 service nova] Creating event network-vif-plugged:fd4499b0-8818-4d57-aba9-bed0b1f2686e for instance 4370218b-d99a-4484-829d-ffa09e867627 on hv-cinder-82002 Jul 12 14:49:04.271850 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-ca560d96-9b84-4a1b-ad62-3b74ac3c5c00 req-e1474c47-90f8-4d8f-ac84-ecca3252e9a8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032437 Jul 12 14:49:04.272489 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 528/1056] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:49:04.389085 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-7083f3c6-be5e-4ac6-b58e-dee53c80091b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:04.397668 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-7083f3c6-be5e-4ac6-b58e-dee53c80091b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627" status: 200 len: 1367 microversion: 2.1 time: 0.167500 Jul 12 14:49:04.398245 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 529/1057] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:04 2022] GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:05.415558 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-32d5118c-8a95-4fa9-ae17-7e052f5b43fa tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:05.416315 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-32d5118c-8a95-4fa9-ae17-7e052f5b43fa tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:05.423555 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-32d5118c-8a95-4fa9-ae17-7e052f5b43fa tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:05.424009 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-32d5118c-8a95-4fa9-ae17-7e052f5b43fa tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:05.424775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-32d5118c-8a95-4fa9-ae17-7e052f5b43fa tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:05.425283 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-32d5118c-8a95-4fa9-ae17-7e052f5b43fa tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:05.554158 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-32d5118c-8a95-4fa9-ae17-7e052f5b43fa tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:05.561475 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-32d5118c-8a95-4fa9-ae17-7e052f5b43fa tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627" status: 200 len: 1367 microversion: 2.1 time: 0.150596 Jul 12 14:49:05.562046 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 529/1058] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:05 2022] GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:06.579370 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-3690dbda-854a-40ec-a34e-b063e68b75ff tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:06.579370 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-3690dbda-854a-40ec-a34e-b063e68b75ff tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:06.585901 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3690dbda-854a-40ec-a34e-b063e68b75ff tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:06.586346 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3690dbda-854a-40ec-a34e-b063e68b75ff tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:06.587110 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3690dbda-854a-40ec-a34e-b063e68b75ff tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:06.587550 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-3690dbda-854a-40ec-a34e-b063e68b75ff tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:06.720173 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-3690dbda-854a-40ec-a34e-b063e68b75ff tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:06.723976 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-3690dbda-854a-40ec-a34e-b063e68b75ff tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627" status: 200 len: 1367 microversion: 2.1 time: 0.149812 Jul 12 14:49:06.724548 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 530/1059] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:06 2022] GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:07.741351 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-f40753b8-975b-4063-a167-801c5f659f78 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:07.741902 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-f40753b8-975b-4063-a167-801c5f659f78 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:07.749024 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f40753b8-975b-4063-a167-801c5f659f78 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:07.749517 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f40753b8-975b-4063-a167-801c5f659f78 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:07.750311 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f40753b8-975b-4063-a167-801c5f659f78 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:07.750752 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f40753b8-975b-4063-a167-801c5f659f78 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:07.876626 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-f40753b8-975b-4063-a167-801c5f659f78 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:07.884458 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-f40753b8-975b-4063-a167-801c5f659f78 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627" status: 200 len: 1367 microversion: 2.1 time: 0.147048 Jul 12 14:49:07.885024 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 530/1060] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:07 2022] GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:08.901270 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-4ddad6f2-3508-405c-9878-468b8215aa37 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:08.901859 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-4ddad6f2-3508-405c-9878-468b8215aa37 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:08.908305 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4ddad6f2-3508-405c-9878-468b8215aa37 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:08.908759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4ddad6f2-3508-405c-9878-468b8215aa37 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:08.909529 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4ddad6f2-3508-405c-9878-468b8215aa37 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:08.909957 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4ddad6f2-3508-405c-9878-468b8215aa37 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:09.035477 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-4ddad6f2-3508-405c-9878-468b8215aa37 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:09.043348 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-4ddad6f2-3508-405c-9878-468b8215aa37 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627" status: 200 len: 1367 microversion: 2.1 time: 0.145957 Jul 12 14:49:09.043906 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 531/1061] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:08 2022] GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:10.060444 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-45563d69-082e-4f03-9cf2-789061d80b5b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:10.060992 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-45563d69-082e-4f03-9cf2-789061d80b5b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:10.067650 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-45563d69-082e-4f03-9cf2-789061d80b5b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:10.068108 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-45563d69-082e-4f03-9cf2-789061d80b5b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:10.068879 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-45563d69-082e-4f03-9cf2-789061d80b5b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:10.069356 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-45563d69-082e-4f03-9cf2-789061d80b5b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:10.200661 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-45563d69-082e-4f03-9cf2-789061d80b5b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:10.208209 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-45563d69-082e-4f03-9cf2-789061d80b5b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627" status: 200 len: 1367 microversion: 2.1 time: 0.151617 Jul 12 14:49:10.208715 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 531/1062] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:10 2022] GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:11.223840 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-716226f3-48d3-4316-8c65-4c657e262b19 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:11.224459 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-716226f3-48d3-4316-8c65-4c657e262b19 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:11.231174 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-716226f3-48d3-4316-8c65-4c657e262b19 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:11.231628 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-716226f3-48d3-4316-8c65-4c657e262b19 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:11.232395 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-716226f3-48d3-4316-8c65-4c657e262b19 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:11.232834 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-716226f3-48d3-4316-8c65-4c657e262b19 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:11.379196 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-716226f3-48d3-4316-8c65-4c657e262b19 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:11.387267 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-716226f3-48d3-4316-8c65-4c657e262b19 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627" status: 200 len: 1367 microversion: 2.1 time: 0.167317 Jul 12 14:49:11.387822 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 532/1063] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:11 2022] GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:12.404197 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-bc7a1689-eae0-4e9b-bf72-ec2fa54b3658 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:12.404963 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-bc7a1689-eae0-4e9b-bf72-ec2fa54b3658 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:12.411507 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bc7a1689-eae0-4e9b-bf72-ec2fa54b3658 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:12.417290 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bc7a1689-eae0-4e9b-bf72-ec2fa54b3658 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:12.417290 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bc7a1689-eae0-4e9b-bf72-ec2fa54b3658 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:12.417290 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-bc7a1689-eae0-4e9b-bf72-ec2fa54b3658 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:12.546222 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-bc7a1689-eae0-4e9b-bf72-ec2fa54b3658 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:12.553558 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-bc7a1689-eae0-4e9b-bf72-ec2fa54b3658 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627" status: 200 len: 1367 microversion: 2.1 time: 0.153723 Jul 12 14:49:12.554119 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 532/1064] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:12 2022] GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:12.988848 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-1c74bdd6-86fc-44b2-9f86-2ee4097d4f06 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1529528003", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-616226702", "security_groups": [{"name": "tempest-secgroup-smoke-1839065815"}], "block_device_mapping_v2": [{"uuid": "224c4ecd-7c44-4d82-91e2-d8b8c40668ed", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "053ecff6-71cf-4863-84fc-402dc3a5230b"}]}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:49:13.099426 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.network.neutron [None req-1c74bdd6-86fc-44b2-9f86-2ee4097d4f06 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] validate_networks() for [('053ecff6-71cf-4863-84fc-402dc3a5230b', None, None, None, None, None)] {{(pid=129981) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:49:13.476189 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-1c74bdd6-86fc-44b2-9f86-2ee4097d4f06 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Flavor limits 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:49:13.476810 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-1c74bdd6-86fc-44b2-9f86-2ee4097d4f06 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Image limits 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:49:13.477404 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-1c74bdd6-86fc-44b2-9f86-2ee4097d4f06 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Flavor pref 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:49:13.477850 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-1c74bdd6-86fc-44b2-9f86-2ee4097d4f06 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Image pref 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:49:13.478265 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-1c74bdd6-86fc-44b2-9f86-2ee4097d4f06 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:49:13.487839 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1c74bdd6-86fc-44b2-9f86-2ee4097d4f06 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:13.488283 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1c74bdd6-86fc-44b2-9f86-2ee4097d4f06 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:13.489067 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1c74bdd6-86fc-44b2-9f86-2ee4097d4f06 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:13.489556 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1c74bdd6-86fc-44b2-9f86-2ee4097d4f06 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:13.507257 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.quota [None req-1c74bdd6-86fc-44b2-9f86-2ee4097d4f06 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Getting quotas for project c361a671e3fc43c8a536f6526dc530b1. Resources: {'instances', 'cores', 'ram'} {{(pid=129981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:49:13.511757 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.quota [None req-1c74bdd6-86fc-44b2-9f86-2ee4097d4f06 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Getting quotas for user 917bfc7c68384536a6945af83308f789 and project c361a671e3fc43c8a536f6526dc530b1. Resources: {'instances', 'cores', 'ram'} {{(pid=129981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:49:13.569567 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-d16879e6-a940-4d3b-8e6d-7af297782957 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:13.570195 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-d16879e6-a940-4d3b-8e6d-7af297782957 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:13.572422 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-1c74bdd6-86fc-44b2-9f86-2ee4097d4f06 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Going to run 1 instances... {{(pid=129981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:49:13.574674 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-1c74bdd6-86fc-44b2-9f86-2ee4097d4f06 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='224c4ecd-7c44-4d82-91e2-d8b8c40668ed',volume_size=None,volume_type=None)] {{(pid=129981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:49:13.576884 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d16879e6-a940-4d3b-8e6d-7af297782957 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:13.580285 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d16879e6-a940-4d3b-8e6d-7af297782957 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:13.580285 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d16879e6-a940-4d3b-8e6d-7af297782957 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:13.580285 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d16879e6-a940-4d3b-8e6d-7af297782957 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:13.597615 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=100 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:13.712434 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-d16879e6-a940-4d3b-8e6d-7af297782957 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:13.720775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-d16879e6-a940-4d3b-8e6d-7af297782957 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627" status: 200 len: 1367 microversion: 2.1 time: 0.155112 Jul 12 14:49:13.723295 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 533/1065] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:13 2022] GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:49:14.033510 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-1c74bdd6-86fc-44b2-9f86-2ee4097d4f06 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.048023 Jul 12 14:49:14.034706 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 533/1066] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Jul 12 14:49:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 1050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:49:14.044657 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-c121c1d9-6fb3-4dc7-b7e1-78eb4f022e99 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:14.045303 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-c121c1d9-6fb3-4dc7-b7e1-78eb4f022e99 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:14.113977 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-c121c1d9-6fb3-4dc7-b7e1-78eb4f022e99 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:14.121344 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-c121c1d9-6fb3-4dc7-b7e1-78eb4f022e99 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 200 len: 1094 microversion: 2.1 time: 0.080489 Jul 12 14:49:14.123237 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 534/1067] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:14 2022] GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:14.737490 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-5a475bd7-d05e-4135-a953-85ac14d88470 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:14.738134 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-5a475bd7-d05e-4135-a953-85ac14d88470 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:14.745134 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5a475bd7-d05e-4135-a953-85ac14d88470 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:14.745603 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5a475bd7-d05e-4135-a953-85ac14d88470 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:14.746422 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5a475bd7-d05e-4135-a953-85ac14d88470 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:14.746854 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-5a475bd7-d05e-4135-a953-85ac14d88470 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:14.750853 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:14.875347 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-5a475bd7-d05e-4135-a953-85ac14d88470 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:14.884607 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-5a475bd7-d05e-4135-a953-85ac14d88470 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627" status: 200 len: 1557 microversion: 2.1 time: 0.151002 Jul 12 14:49:14.885493 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 534/1068] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:14 2022] GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:14.901935 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-9646e7f1-7ec5-45e7-ba65-3894f62df981 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:14.902474 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-9646e7f1-7ec5-45e7-ba65-3894f62df981 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:14.908886 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9646e7f1-7ec5-45e7-ba65-3894f62df981 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:14.911241 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9646e7f1-7ec5-45e7-ba65-3894f62df981 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:14.911241 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9646e7f1-7ec5-45e7-ba65-3894f62df981 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:14.911241 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9646e7f1-7ec5-45e7-ba65-3894f62df981 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:14.988031 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-9646e7f1-7ec5-45e7-ba65-3894f62df981 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090514 Jul 12 14:49:14.988578 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 535/1069] 10.222.0.30 () {58 vars in 1274 bytes} [Tue Jul 12 14:49:14 2022] GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:49:15.139240 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e6181729-dc61-4ca8-8b81-4c17c2f7eb80 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:15.140304 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-e6181729-dc61-4ca8-8b81-4c17c2f7eb80 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:15.147037 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e6181729-dc61-4ca8-8b81-4c17c2f7eb80 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:15.147580 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e6181729-dc61-4ca8-8b81-4c17c2f7eb80 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:15.148413 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e6181729-dc61-4ca8-8b81-4c17c2f7eb80 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:15.148971 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e6181729-dc61-4ca8-8b81-4c17c2f7eb80 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:15.229130 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e6181729-dc61-4ca8-8b81-4c17c2f7eb80 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:15.236745 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-e6181729-dc61-4ca8-8b81-4c17c2f7eb80 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 200 len: 1144 microversion: 2.1 time: 0.102026 Jul 12 14:49:15.237346 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 535/1070] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:15 2022] GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 1144 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:49:16.254540 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-1e7c9c51-043a-4c5e-a09c-9c6eaac417df tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:16.255619 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-1e7c9c51-043a-4c5e-a09c-9c6eaac417df tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:16.262062 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1e7c9c51-043a-4c5e-a09c-9c6eaac417df tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:16.262584 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1e7c9c51-043a-4c5e-a09c-9c6eaac417df tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:16.263440 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1e7c9c51-043a-4c5e-a09c-9c6eaac417df tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:16.263881 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1e7c9c51-043a-4c5e-a09c-9c6eaac417df tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:16.369351 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-1e7c9c51-043a-4c5e-a09c-9c6eaac417df tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:16.380355 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-1e7c9c51-043a-4c5e-a09c-9c6eaac417df tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 200 len: 1200 microversion: 2.1 time: 0.128085 Jul 12 14:49:16.384942 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 536/1071] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:16 2022] GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 1200 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:16.395797 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-c9d87422-b98d-4609-b4f5-d9a70a0add73 req-6db425b7-80a8-4cc3-bde4-eaf0b8c6efe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4370218b-d99a-4484-829d-ffa09e867627", "tag": "fd4499b0-8818-4d57-aba9-bed0b1f2686e"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:49:16.404936 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-c9d87422-b98d-4609-b4f5-d9a70a0add73 req-6db425b7-80a8-4cc3-bde4-eaf0b8c6efe8 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:16.405402 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-c9d87422-b98d-4609-b4f5-d9a70a0add73 req-6db425b7-80a8-4cc3-bde4-eaf0b8c6efe8 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:16.416143 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-c9d87422-b98d-4609-b4f5-d9a70a0add73 req-6db425b7-80a8-4cc3-bde4-eaf0b8c6efe8 service nova] Creating event network-changed:fd4499b0-8818-4d57-aba9-bed0b1f2686e for instance 4370218b-d99a-4484-829d-ffa09e867627 on hv-cinder-82002 Jul 12 14:49:16.421764 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-c9d87422-b98d-4609-b4f5-d9a70a0add73 req-6db425b7-80a8-4cc3-bde4-eaf0b8c6efe8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029683 Jul 12 14:49:16.422352 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 536/1072] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:49:17.395066 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-9ed745bd-4321-48e6-b663-3590e6be5eec tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:17.395661 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-9ed745bd-4321-48e6-b663-3590e6be5eec tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:17.403188 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9ed745bd-4321-48e6-b663-3590e6be5eec tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:17.403635 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9ed745bd-4321-48e6-b663-3590e6be5eec tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:17.404405 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9ed745bd-4321-48e6-b663-3590e6be5eec tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:17.404842 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9ed745bd-4321-48e6-b663-3590e6be5eec tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:17.741011 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-9ed745bd-4321-48e6-b663-3590e6be5eec tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:17.748906 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-9ed745bd-4321-48e6-b663-3590e6be5eec tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 200 len: 1210 microversion: 2.1 time: 0.357871 Jul 12 14:49:17.749564 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 537/1073] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:17 2022] GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 1210 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:18.770471 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-855b512f-2416-4225-94b7-8efa2061eca3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:18.771164 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-855b512f-2416-4225-94b7-8efa2061eca3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:18.778189 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-855b512f-2416-4225-94b7-8efa2061eca3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:18.778638 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-855b512f-2416-4225-94b7-8efa2061eca3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:18.779398 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-855b512f-2416-4225-94b7-8efa2061eca3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:18.779834 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-855b512f-2416-4225-94b7-8efa2061eca3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:18.896796 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-855b512f-2416-4225-94b7-8efa2061eca3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:18.905015 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-855b512f-2416-4225-94b7-8efa2061eca3 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 200 len: 1210 microversion: 2.1 time: 0.139466 Jul 12 14:49:18.905610 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 537/1074] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:18 2022] GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 1210 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:19.924258 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-734a3e44-8d63-487c-a5cb-74091e90c553 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:19.925617 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-734a3e44-8d63-487c-a5cb-74091e90c553 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:19.940378 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-734a3e44-8d63-487c-a5cb-74091e90c553 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:19.940378 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-734a3e44-8d63-487c-a5cb-74091e90c553 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:19.940378 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-734a3e44-8d63-487c-a5cb-74091e90c553 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:19.940378 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-734a3e44-8d63-487c-a5cb-74091e90c553 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:20.115926 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-734a3e44-8d63-487c-a5cb-74091e90c553 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:20.128876 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-734a3e44-8d63-487c-a5cb-74091e90c553 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 200 len: 1278 microversion: 2.1 time: 0.208465 Jul 12 14:49:20.130277 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 538/1075] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:19 2022] GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 1278 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:20.848228 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-515d2805-b09e-41c0-afc2-702205171a9a req-8372aed6-f831-4256-816b-feea67c5d06f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9", "tag": "cc4460df-a6f5-4837-9f82-68d3b6142fc5"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:49:20.859115 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-515d2805-b09e-41c0-afc2-702205171a9a req-8372aed6-f831-4256-816b-feea67c5d06f service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:20.859667 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-515d2805-b09e-41c0-afc2-702205171a9a req-8372aed6-f831-4256-816b-feea67c5d06f service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:20.886536 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-515d2805-b09e-41c0-afc2-702205171a9a req-8372aed6-f831-4256-816b-feea67c5d06f service nova] Creating event network-changed:cc4460df-a6f5-4837-9f82-68d3b6142fc5 for instance 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 on hv-cinder-82002 Jul 12 14:49:20.891993 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-515d2805-b09e-41c0-afc2-702205171a9a req-8372aed6-f831-4256-816b-feea67c5d06f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049347 Jul 12 14:49:20.892856 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 538/1076] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:49:21.146275 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-797cd306-aaaf-4bc8-9e1e-a873e0ce0316 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:21.146797 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-797cd306-aaaf-4bc8-9e1e-a873e0ce0316 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:21.153509 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-797cd306-aaaf-4bc8-9e1e-a873e0ce0316 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:21.160133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-797cd306-aaaf-4bc8-9e1e-a873e0ce0316 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:21.160133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-797cd306-aaaf-4bc8-9e1e-a873e0ce0316 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:21.160133 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-797cd306-aaaf-4bc8-9e1e-a873e0ce0316 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:21.291341 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-797cd306-aaaf-4bc8-9e1e-a873e0ce0316 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:21.299612 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-797cd306-aaaf-4bc8-9e1e-a873e0ce0316 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 200 len: 1266 microversion: 2.1 time: 0.157417 Jul 12 14:49:21.300177 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 539/1077] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:21 2022] GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:22.318180 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-a8997df4-d038-4a05-9d91-2f1cd23a06aa tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:22.318880 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-a8997df4-d038-4a05-9d91-2f1cd23a06aa tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:22.325816 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a8997df4-d038-4a05-9d91-2f1cd23a06aa tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:22.326273 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a8997df4-d038-4a05-9d91-2f1cd23a06aa tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:22.327042 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a8997df4-d038-4a05-9d91-2f1cd23a06aa tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:22.327483 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a8997df4-d038-4a05-9d91-2f1cd23a06aa tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:22.457483 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-a8997df4-d038-4a05-9d91-2f1cd23a06aa tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:22.467235 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-a8997df4-d038-4a05-9d91-2f1cd23a06aa tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 200 len: 1266 microversion: 2.1 time: 0.153888 Jul 12 14:49:22.467804 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 539/1078] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:22 2022] GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:23.484180 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-01b27661-efe5-405a-9e8e-ce9bc73967b9 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:23.484799 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-01b27661-efe5-405a-9e8e-ce9bc73967b9 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:23.491489 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-01b27661-efe5-405a-9e8e-ce9bc73967b9 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:23.491942 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-01b27661-efe5-405a-9e8e-ce9bc73967b9 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:23.492707 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-01b27661-efe5-405a-9e8e-ce9bc73967b9 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:23.493147 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-01b27661-efe5-405a-9e8e-ce9bc73967b9 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:23.623440 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-01b27661-efe5-405a-9e8e-ce9bc73967b9 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:23.631175 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-01b27661-efe5-405a-9e8e-ce9bc73967b9 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 200 len: 1266 microversion: 2.1 time: 0.150853 Jul 12 14:49:23.631742 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 540/1079] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:23 2022] GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:24.647943 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-9a8f38e9-e0f0-4607-96dc-89c4521d37be tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:24.648564 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-9a8f38e9-e0f0-4607-96dc-89c4521d37be tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:24.651020 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell0:SELECT=2 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:24.651697 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell0:SELECT=6 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:24.657732 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9a8f38e9-e0f0-4607-96dc-89c4521d37be tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:24.657948 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9a8f38e9-e0f0-4607-96dc-89c4521d37be tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:24.658729 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9a8f38e9-e0f0-4607-96dc-89c4521d37be tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:24.659225 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9a8f38e9-e0f0-4607-96dc-89c4521d37be tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:24.800265 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-9a8f38e9-e0f0-4607-96dc-89c4521d37be tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:24.807671 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-9a8f38e9-e0f0-4607-96dc-89c4521d37be tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 200 len: 1266 microversion: 2.1 time: 0.163693 Jul 12 14:49:24.808230 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 540/1080] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:24 2022] GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:25.824357 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-7c2cfcef-fce7-464d-9845-3f3376a330ff tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:25.824970 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-7c2cfcef-fce7-464d-9845-3f3376a330ff tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:25.826945 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell0:SELECT=2 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:25.832185 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7c2cfcef-fce7-464d-9845-3f3376a330ff tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:25.832639 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7c2cfcef-fce7-464d-9845-3f3376a330ff tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:25.833562 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7c2cfcef-fce7-464d-9845-3f3376a330ff tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:25.834005 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7c2cfcef-fce7-464d-9845-3f3376a330ff tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:25.968575 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-7c2cfcef-fce7-464d-9845-3f3376a330ff tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:25.979121 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-7c2cfcef-fce7-464d-9845-3f3376a330ff tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 200 len: 1266 microversion: 2.1 time: 0.155713 Jul 12 14:49:25.979121 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 541/1081] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:25 2022] GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:26.993136 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-65667f3e-cd19-46cf-9464-4440bb8d5226 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:26.993835 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-65667f3e-cd19-46cf-9464-4440bb8d5226 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:27.000545 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-65667f3e-cd19-46cf-9464-4440bb8d5226 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:27.000996 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-65667f3e-cd19-46cf-9464-4440bb8d5226 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:27.001796 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-65667f3e-cd19-46cf-9464-4440bb8d5226 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:27.002234 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-65667f3e-cd19-46cf-9464-4440bb8d5226 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:27.135941 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-65667f3e-cd19-46cf-9464-4440bb8d5226 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:27.143404 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-65667f3e-cd19-46cf-9464-4440bb8d5226 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 200 len: 1266 microversion: 2.1 time: 0.154508 Jul 12 14:49:27.143965 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 541/1082] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:26 2022] GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:28.114709 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-310a31fa-1c05-475a-8c32-a85b9e55d084 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:28.115205 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-310a31fa-1c05-475a-8c32-a85b9e55d084 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:28.122187 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-310a31fa-1c05-475a-8c32-a85b9e55d084 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:28.122640 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-310a31fa-1c05-475a-8c32-a85b9e55d084 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:28.123406 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-310a31fa-1c05-475a-8c32-a85b9e55d084 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:28.123843 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-310a31fa-1c05-475a-8c32-a85b9e55d084 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:28.159677 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-2a507b7b-4eba-4821-ae6f-2c40756c8e71 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:28.160250 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-2a507b7b-4eba-4821-ae6f-2c40756c8e71 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:28.166632 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2a507b7b-4eba-4821-ae6f-2c40756c8e71 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:28.167072 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2a507b7b-4eba-4821-ae6f-2c40756c8e71 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:28.167853 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2a507b7b-4eba-4821-ae6f-2c40756c8e71 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:28.168291 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2a507b7b-4eba-4821-ae6f-2c40756c8e71 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:28.204813 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.objects.instance [None req-310a31fa-1c05-475a-8c32-a85b9e55d084 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lazy-loading 'services' on Instance uuid 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a {{(pid=129980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:49:28.303922 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-2a507b7b-4eba-4821-ae6f-2c40756c8e71 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:28.312078 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-2a507b7b-4eba-4821-ae6f-2c40756c8e71 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 200 len: 1266 microversion: 2.1 time: 0.155776 Jul 12 14:49:28.312642 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 542/1083] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:28 2022] GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:28.330541 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 14:49:28.330728 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Tue Jul 12 14:49:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a/os-volume_attachments/6f7cf3a7-4751-4f42-856c-cf26257c00b5 (ip 10.222.0.30) !!! Jul 12 14:49:28.433839 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-310a31fa-1c05-475a-8c32-a85b9e55d084 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "DELETE /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a/os-volume_attachments/6f7cf3a7-4751-4f42-856c-cf26257c00b5" status: 202 len: 0 microversion: 2.1 time: 0.322948 Jul 12 14:49:28.434510 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 542/1084] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Jul 12 14:49:28 2022] DELETE /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a/os-volume_attachments/6f7cf3a7-4751-4f42-856c-cf26257c00b5 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:49:29.328246 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-be15bcb9-63a5-4973-af93-23bfff3ff7c2 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:29.328930 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-be15bcb9-63a5-4973-af93-23bfff3ff7c2 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:29.335567 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-be15bcb9-63a5-4973-af93-23bfff3ff7c2 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:29.336015 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-be15bcb9-63a5-4973-af93-23bfff3ff7c2 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:29.336775 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-be15bcb9-63a5-4973-af93-23bfff3ff7c2 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:29.337275 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-be15bcb9-63a5-4973-af93-23bfff3ff7c2 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:29.466019 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-be15bcb9-63a5-4973-af93-23bfff3ff7c2 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:29.473924 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-be15bcb9-63a5-4973-af93-23bfff3ff7c2 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 200 len: 1266 microversion: 2.1 time: 0.150075 Jul 12 14:49:29.474488 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 543/1085] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:29 2022] GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:30.491609 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-5f082e5e-69d3-4cac-be52-af39539d3206 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:30.492310 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-5f082e5e-69d3-4cac-be52-af39539d3206 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:30.498536 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5f082e5e-69d3-4cac-be52-af39539d3206 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:30.499636 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5f082e5e-69d3-4cac-be52-af39539d3206 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:30.500400 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5f082e5e-69d3-4cac-be52-af39539d3206 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:30.500838 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5f082e5e-69d3-4cac-be52-af39539d3206 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:30.597076 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-91b03ede-1c3b-483b-a7f0-742473e093c9 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:30.597586 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-91b03ede-1c3b-483b-a7f0-742473e093c9 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:30.599876 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:30.604656 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-91b03ede-1c3b-483b-a7f0-742473e093c9 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:30.605089 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-91b03ede-1c3b-483b-a7f0-742473e093c9 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:30.605902 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-91b03ede-1c3b-483b-a7f0-742473e093c9 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:30.606385 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-91b03ede-1c3b-483b-a7f0-742473e093c9 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:30.632788 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-91b03ede-1c3b-483b-a7f0-742473e093c9 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a] Going to try to terminate instance {{(pid=129981) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:49:30.639192 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-5f082e5e-69d3-4cac-be52-af39539d3206 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:30.646772 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-5f082e5e-69d3-4cac-be52-af39539d3206 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 200 len: 1266 microversion: 2.1 time: 0.159824 Jul 12 14:49:30.647352 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 543/1086] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:30 2022] GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:30.977575 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-91b03ede-1c3b-483b-a7f0-742473e093c9 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "DELETE /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a" status: 204 len: 0 microversion: 2.1 time: 0.383974 Jul 12 14:49:30.978260 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 544/1087] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Jul 12 14:49:30 2022] DELETE /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 14:49:30.987117 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-2498a17c-eaf4-4e51-8ecd-274c725e86b6 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:30.987739 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-2498a17c-eaf4-4e51-8ecd-274c725e86b6 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:30.993781 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2498a17c-eaf4-4e51-8ecd-274c725e86b6 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:30.994273 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2498a17c-eaf4-4e51-8ecd-274c725e86b6 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:30.995048 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2498a17c-eaf4-4e51-8ecd-274c725e86b6 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:30.995489 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2498a17c-eaf4-4e51-8ecd-274c725e86b6 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:31.122944 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-2498a17c-eaf4-4e51-8ecd-274c725e86b6 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:31.130724 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-2498a17c-eaf4-4e51-8ecd-274c725e86b6 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a" status: 200 len: 1514 microversion: 2.1 time: 0.148085 Jul 12 14:49:31.131340 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 544/1088] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:30 2022] GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:49:31.664735 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-53195eb1-68e3-4cf7-a89e-e09acf5f61c1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:31.665457 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-53195eb1-68e3-4cf7-a89e-e09acf5f61c1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:31.672433 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-53195eb1-68e3-4cf7-a89e-e09acf5f61c1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:31.672875 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-53195eb1-68e3-4cf7-a89e-e09acf5f61c1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:31.673658 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-53195eb1-68e3-4cf7-a89e-e09acf5f61c1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:31.674090 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-53195eb1-68e3-4cf7-a89e-e09acf5f61c1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:31.810198 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-53195eb1-68e3-4cf7-a89e-e09acf5f61c1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:31.817701 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-53195eb1-68e3-4cf7-a89e-e09acf5f61c1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 200 len: 1266 microversion: 2.1 time: 0.157458 Jul 12 14:49:31.821718 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 545/1089] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:31 2022] GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:32.148506 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-d3f83859-49b8-48d1-818f-448aa38d642c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:32.149115 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-d3f83859-49b8-48d1-818f-448aa38d642c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:32.155668 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d3f83859-49b8-48d1-818f-448aa38d642c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:32.156111 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d3f83859-49b8-48d1-818f-448aa38d642c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:32.156864 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d3f83859-49b8-48d1-818f-448aa38d642c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:32.157323 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d3f83859-49b8-48d1-818f-448aa38d642c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:32.284003 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-d3f83859-49b8-48d1-818f-448aa38d642c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:32.291554 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-d3f83859-49b8-48d1-818f-448aa38d642c tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a" status: 200 len: 1514 microversion: 2.1 time: 0.146829 Jul 12 14:49:32.292225 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 545/1090] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:32 2022] GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:32.834430 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-b3272ca8-ea96-4cee-b296-78ca4d158d18 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:32.834975 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-b3272ca8-ea96-4cee-b296-78ca4d158d18 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:32.841422 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b3272ca8-ea96-4cee-b296-78ca4d158d18 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:32.841886 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b3272ca8-ea96-4cee-b296-78ca4d158d18 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:32.843258 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b3272ca8-ea96-4cee-b296-78ca4d158d18 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:32.843689 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b3272ca8-ea96-4cee-b296-78ca4d158d18 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:32.972255 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-b3272ca8-ea96-4cee-b296-78ca4d158d18 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:32.979894 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-b3272ca8-ea96-4cee-b296-78ca4d158d18 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 200 len: 1266 microversion: 2.1 time: 0.149465 Jul 12 14:49:32.980494 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 546/1091] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:32 2022] GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:33.309292 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-405420a8-0932-48b6-bc1c-8350a4930fb2 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:33.309949 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-405420a8-0932-48b6-bc1c-8350a4930fb2 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:33.312834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_api:SELECT=40 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:33.317605 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-405420a8-0932-48b6-bc1c-8350a4930fb2 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:33.318059 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-405420a8-0932-48b6-bc1c-8350a4930fb2 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:33.318822 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-405420a8-0932-48b6-bc1c-8350a4930fb2 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:33.319260 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-405420a8-0932-48b6-bc1c-8350a4930fb2 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:33.476843 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-405420a8-0932-48b6-bc1c-8350a4930fb2 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:33.484794 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-405420a8-0932-48b6-bc1c-8350a4930fb2 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a" status: 200 len: 1514 microversion: 2.1 time: 0.179372 Jul 12 14:49:33.485396 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 546/1092] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:33 2022] GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:33.996861 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-efacfb8b-4a97-4954-958d-afad6ba15035 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:33.998602 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-efacfb8b-4a97-4954-958d-afad6ba15035 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:34.005760 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-efacfb8b-4a97-4954-958d-afad6ba15035 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:34.006373 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-efacfb8b-4a97-4954-958d-afad6ba15035 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:34.007269 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-efacfb8b-4a97-4954-958d-afad6ba15035 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:34.007798 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-efacfb8b-4a97-4954-958d-afad6ba15035 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:34.110734 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-c1124ce2-ac31-4fc4-8008-d84f420c0635 req-1a3d88b5-69e9-45f1-a790-cb1e6759209d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "446a84da-7f55-4b8a-8b09-ffcc85cc3a0a", "name": "network-vif-deleted", "tag": "2d1128ff-70e1-441b-8b0f-16f0a58b51f6"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:49:34.120844 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-c1124ce2-ac31-4fc4-8008-d84f420c0635 req-1a3d88b5-69e9-45f1-a790-cb1e6759209d service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:34.121392 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-c1124ce2-ac31-4fc4-8008-d84f420c0635 req-1a3d88b5-69e9-45f1-a790-cb1e6759209d service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:34.134338 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-c1124ce2-ac31-4fc4-8008-d84f420c0635 req-1a3d88b5-69e9-45f1-a790-cb1e6759209d service nova] Creating event network-vif-deleted:2d1128ff-70e1-441b-8b0f-16f0a58b51f6 for instance 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a on hv-cinder-82002 Jul 12 14:49:34.139531 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-c1124ce2-ac31-4fc4-8008-d84f420c0635 req-1a3d88b5-69e9-45f1-a790-cb1e6759209d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034112 Jul 12 14:49:34.140213 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 547/1093] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:49:34.179288 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-efacfb8b-4a97-4954-958d-afad6ba15035 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:34.188446 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-efacfb8b-4a97-4954-958d-afad6ba15035 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 200 len: 1266 microversion: 2.1 time: 0.195428 Jul 12 14:49:34.189200 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 547/1094] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:33 2022] GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:34.502025 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-2a4aecfc-0fea-44cd-9b11-79376a57a9ee tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:34.503428 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-2a4aecfc-0fea-44cd-9b11-79376a57a9ee tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:34.510160 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2a4aecfc-0fea-44cd-9b11-79376a57a9ee tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:34.510656 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2a4aecfc-0fea-44cd-9b11-79376a57a9ee tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:34.511453 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2a4aecfc-0fea-44cd-9b11-79376a57a9ee tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:34.512068 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2a4aecfc-0fea-44cd-9b11-79376a57a9ee tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:34.579870 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-2a4aecfc-0fea-44cd-9b11-79376a57a9ee tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:34.587637 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-2a4aecfc-0fea-44cd-9b11-79376a57a9ee tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a" status: 200 len: 1304 microversion: 2.1 time: 0.090372 Jul 12 14:49:34.588205 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 548/1095] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:34 2022] GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:35.205841 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d8ebbfec-2e76-422d-afe6-74d1679329c0 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:35.206475 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-d8ebbfec-2e76-422d-afe6-74d1679329c0 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:35.213231 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d8ebbfec-2e76-422d-afe6-74d1679329c0 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:35.213687 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d8ebbfec-2e76-422d-afe6-74d1679329c0 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:35.214463 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d8ebbfec-2e76-422d-afe6-74d1679329c0 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:35.214903 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d8ebbfec-2e76-422d-afe6-74d1679329c0 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:35.343544 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d8ebbfec-2e76-422d-afe6-74d1679329c0 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:35.350970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-d8ebbfec-2e76-422d-afe6-74d1679329c0 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 200 len: 1266 microversion: 2.1 time: 0.149626 Jul 12 14:49:35.351523 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 548/1096] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:35 2022] GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:35.606783 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-6794be9e-7347-473a-bb7f-09391f78a464 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:35.607379 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-6794be9e-7347-473a-bb7f-09391f78a464 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:35.614486 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6794be9e-7347-473a-bb7f-09391f78a464 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:35.618268 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6794be9e-7347-473a-bb7f-09391f78a464 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:35.618268 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6794be9e-7347-473a-bb7f-09391f78a464 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:35.618268 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6794be9e-7347-473a-bb7f-09391f78a464 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:35.648275 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6794be9e-7347-473a-bb7f-09391f78a464 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:35.648528 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6794be9e-7347-473a-bb7f-09391f78a464 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:35.648979 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.objects.instance [None req-6794be9e-7347-473a-bb7f-09391f78a464 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lazy-loading 'fault' on Instance uuid 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a {{(pid=129980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:49:35.692014 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-6794be9e-7347-473a-bb7f-09391f78a464 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b123a78349c4daba0502a4e9e98245f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89c4c765f5243eaa314231429d20598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:35.699807 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-6794be9e-7347-473a-bb7f-09391f78a464 tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a" status: 200 len: 1309 microversion: 2.1 time: 0.097206 Jul 12 14:49:35.700383 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 549/1097] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:35 2022] GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:35.818628 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-b2ea80b6-b5b8-462f-93a7-3e9d5a453dad req-b99a0361-401c-42ae-b73d-09efe17928bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9", "name": "network-vif-plugged", "status": "completed", "tag": "cc4460df-a6f5-4837-9f82-68d3b6142fc5"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:49:35.827235 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-b2ea80b6-b5b8-462f-93a7-3e9d5a453dad req-b99a0361-401c-42ae-b73d-09efe17928bb service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:35.827685 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-b2ea80b6-b5b8-462f-93a7-3e9d5a453dad req-b99a0361-401c-42ae-b73d-09efe17928bb service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:35.838704 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-b2ea80b6-b5b8-462f-93a7-3e9d5a453dad req-b99a0361-401c-42ae-b73d-09efe17928bb service nova] Creating event network-vif-plugged:cc4460df-a6f5-4837-9f82-68d3b6142fc5 for instance 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 on hv-cinder-82002 Jul 12 14:49:35.843599 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-b2ea80b6-b5b8-462f-93a7-3e9d5a453dad req-b99a0361-401c-42ae-b73d-09efe17928bb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028777 Jul 12 14:49:35.844183 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 549/1098] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:49:36.367608 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-32d72c43-471a-4df8-8c57-7945e580b74f tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:36.368152 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-32d72c43-471a-4df8-8c57-7945e580b74f tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:36.374868 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-32d72c43-471a-4df8-8c57-7945e580b74f tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:36.375312 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-32d72c43-471a-4df8-8c57-7945e580b74f tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:36.376064 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-32d72c43-471a-4df8-8c57-7945e580b74f tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:36.376498 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-32d72c43-471a-4df8-8c57-7945e580b74f tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:36.505525 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-32d72c43-471a-4df8-8c57-7945e580b74f tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:36.512843 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-32d72c43-471a-4df8-8c57-7945e580b74f tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 200 len: 1266 microversion: 2.1 time: 0.149243 Jul 12 14:49:36.513434 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 550/1099] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:36 2022] GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:36.718475 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-24a3f7f3-609a-44cf-bdcb-767ba24a59dd tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:36.719173 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-24a3f7f3-609a-44cf-bdcb-767ba24a59dd tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] [instance: 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:36.725441 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-24a3f7f3-609a-44cf-bdcb-767ba24a59dd tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:36.725895 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-24a3f7f3-609a-44cf-bdcb-767ba24a59dd tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:36.726657 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-24a3f7f3-609a-44cf-bdcb-767ba24a59dd tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:36.727107 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-24a3f7f3-609a-44cf-bdcb-767ba24a59dd tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:36.740653 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.wsgi [None req-24a3f7f3-609a-44cf-bdcb-767ba24a59dd tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] HTTP exception thrown: Instance 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a could not be found. Jul 12 14:49:36.742271 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-24a3f7f3-609a-44cf-bdcb-767ba24a59dd tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Request method failure captured: Jul 12 14:49:36.742271 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a HTTP/1.1 Jul 12 14:49:36.742271 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:49:36.742271 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:49:36.742271 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:49:36.742271 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 0 Jul 12 14:49:36.742271 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:49:36.742271 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:49:36.742271 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:49:36.742271 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:49:36.742271 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYlyqxhjCG00wqhXs2ZqIJlvT-WrSNz3APuR7teNrDg9nTAuMLa463GgaKhYcdsrFQq492L4JBqoD6yptqNmNMsOUlHPOKEdUZY4iXCiqsCGs9-RrlER2SDr9PsgWR6Czhx6D54k1Ku9BtSXyRvQ_iJUKtYiMFYQOJ6-mo--QikJRs8 Jul 12 14:49:36.742271 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:49:36.742271 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:49:36.742271 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:49:36.742271 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:49:36.742271 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:49:36.742271 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:49:36.742271 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: e89c4c765f5243eaa314231429d20598 Jul 12 14:49:36.742271 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1496703537 Jul 12 14:49:36.742271 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:49:36.742271 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:49:36.743959 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e89c4c765f5243eaa314231429d20598"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e89c4c765f5243eaa314231429d20598"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e89c4c765f5243eaa314231429d20598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e89c4c765f5243eaa314231429d20598", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:49:36.743959 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-VolumesSnapshotTestJSON-1496703537 Jul 12 14:49:36.743959 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: e89c4c765f5243eaa314231429d20598 Jul 12 14:49:36.743959 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1496703537 Jul 12 14:49:36.743959 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-VolumesSnapshotTestJSON-1496703537-project Jul 12 14:49:36.743959 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:49:36.743959 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:49:36.743959 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: 2b123a78349c4daba0502a4e9e98245f Jul 12 14:49:36.743959 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-VolumesSnapshotTestJSON-1496703537-project Jul 12 14:49:36.743959 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: > Jul 12 14:49:36.743959 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Instance 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a could not be found. Jul 12 14:49:36.743959 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'id': '446a84da-7f55-4b8a-8b09-ffcc85cc3a0a'} Jul 12 14:49:36.745017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:49:36.745017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:49:36.745017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:49:36.745017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:49:36.745017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:49:36.745017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:49:36.745017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:49:36.745017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:49:36.745017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:49:36.745017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:49:36.745017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a could not be found. Jul 12 14:49:36.745017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:49:36.745017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:49:36.745017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:49:36.745017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:49:36.745017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:49:36.745017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:49:36.745017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:49:36.745017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:49:36.745017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:49:36.746774 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:49:36.746774 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:49:36.746774 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:49:36.746774 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:49:36.746774 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:49:36.746774 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:49:36.746774 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:49:36.746774 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a could not be found. Jul 12 14:49:36.746774 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:49:36.746774 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:49:36.746774 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:49:36.746774 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:49:36.746774 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:49:36.746774 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:49:36.746774 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:49:36.746774 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:49:36.746774 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a could not be found. Jul 12 14:49:36.746774 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:49:36.748585 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-24a3f7f3-609a-44cf-bdcb-767ba24a59dd tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] Returning 404 to user: Instance 446a84da-7f55-4b8a-8b09-ffcc85cc3a0a could not be found. {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:49:36.748585 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-24a3f7f3-609a-44cf-bdcb-767ba24a59dd tempest-VolumesSnapshotTestJSON-1496703537 tempest-VolumesSnapshotTestJSON-1496703537-project] 10.222.0.30 "GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a" status: 404 len: 111 microversion: 2.1 time: 0.030487 Jul 12 14:49:36.748585 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 550/1100] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:36 2022] GET /compute/v2.1/servers/446a84da-7f55-4b8a-8b09-ffcc85cc3a0a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:49:37.529417 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-06e7d889-364a-4eec-b26b-77854957eaf6 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:37.530031 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-06e7d889-364a-4eec-b26b-77854957eaf6 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:37.536400 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-06e7d889-364a-4eec-b26b-77854957eaf6 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:37.536850 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-06e7d889-364a-4eec-b26b-77854957eaf6 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:37.537701 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-06e7d889-364a-4eec-b26b-77854957eaf6 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:37.538146 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-06e7d889-364a-4eec-b26b-77854957eaf6 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:37.542208 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:37.672357 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-06e7d889-364a-4eec-b26b-77854957eaf6 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:37.680010 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-06e7d889-364a-4eec-b26b-77854957eaf6 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 200 len: 1266 microversion: 2.1 time: 0.154551 Jul 12 14:49:37.680575 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 551/1101] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:37 2022] GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:38.696601 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-de270659-dfed-4089-9127-8dc35e657bdc tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:38.697245 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-de270659-dfed-4089-9127-8dc35e657bdc tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:38.704311 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-de270659-dfed-4089-9127-8dc35e657bdc tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:38.704758 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-de270659-dfed-4089-9127-8dc35e657bdc tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:38.705555 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-de270659-dfed-4089-9127-8dc35e657bdc tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:38.705989 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-de270659-dfed-4089-9127-8dc35e657bdc tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:38.840228 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-de270659-dfed-4089-9127-8dc35e657bdc tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:38.843197 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:38.849511 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-de270659-dfed-4089-9127-8dc35e657bdc tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 200 len: 1452 microversion: 2.1 time: 0.156779 Jul 12 14:49:38.850085 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 551/1102] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:38 2022] GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:49:38.867052 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-d9beaad5-f7eb-42e6-9d20-782db4699ab7 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:49:38.867598 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-d9beaad5-f7eb-42e6-9d20-782db4699ab7 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:49:38.874758 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d9beaad5-f7eb-42e6-9d20-782db4699ab7 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:38.875209 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d9beaad5-f7eb-42e6-9d20-782db4699ab7 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:38.875960 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d9beaad5-f7eb-42e6-9d20-782db4699ab7 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:38.876391 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d9beaad5-f7eb-42e6-9d20-782db4699ab7 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:39.004546 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-d9beaad5-f7eb-42e6-9d20-782db4699ab7 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:49:39.012190 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-d9beaad5-f7eb-42e6-9d20-782db4699ab7 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 200 len: 1452 microversion: 2.1 time: 0.149733 Jul 12 14:49:39.012758 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 552/1103] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:49:38 2022] GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:49:41.220769 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-3a9513b1-cb58-4a0c-a46a-254ffd955f65 req-9e15db73-6d42-43ea-8a0f-fdd0297eab11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9", "tag": "cc4460df-a6f5-4837-9f82-68d3b6142fc5"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:49:41.229731 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-3a9513b1-cb58-4a0c-a46a-254ffd955f65 req-9e15db73-6d42-43ea-8a0f-fdd0297eab11 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:49:41.230184 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-3a9513b1-cb58-4a0c-a46a-254ffd955f65 req-9e15db73-6d42-43ea-8a0f-fdd0297eab11 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:49:41.241850 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-3a9513b1-cb58-4a0c-a46a-254ffd955f65 req-9e15db73-6d42-43ea-8a0f-fdd0297eab11 service nova] Creating event network-changed:cc4460df-a6f5-4837-9f82-68d3b6142fc5 for instance 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 on hv-cinder-82002 Jul 12 14:49:41.246868 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-3a9513b1-cb58-4a0c-a46a-254ffd955f65 req-9e15db73-6d42-43ea-8a0f-fdd0297eab11 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030693 Jul 12 14:49:41.247461 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 552/1104] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:50:00.009439 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-de5a8a35-8578-4f3b-a49d-f5fe61297922 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:00.010316 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-de5a8a35-8578-4f3b-a49d-f5fe61297922 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:00.012918 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_api:SELECT=15 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:00.013621 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=10 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:00.018780 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-de5a8a35-8578-4f3b-a49d-f5fe61297922 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:00.019230 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-de5a8a35-8578-4f3b-a49d-f5fe61297922 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:00.020009 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-de5a8a35-8578-4f3b-a49d-f5fe61297922 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:00.020483 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-de5a8a35-8578-4f3b-a49d-f5fe61297922 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:00.046379 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-de5a8a35-8578-4f3b-a49d-f5fe61297922 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627/ips" status: 200 len: 148 microversion: 2.1 time: 0.041140 Jul 12 14:50:00.046967 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 553/1105] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Jul 12 14:50:00 2022] GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627/ips => generated 148 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:50:00.055925 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:00.060540 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-25b812a2-ed3e-4a3a-a4f2-375e4e723085 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf26a4e7-7ae1-4293-995c-18d979dae53f"}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:50:00.062042 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-25b812a2-ed3e-4a3a-a4f2-375e4e723085 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:00.068880 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-25b812a2-ed3e-4a3a-a4f2-375e4e723085 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:00.069352 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-25b812a2-ed3e-4a3a-a4f2-375e4e723085 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:00.070115 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-25b812a2-ed3e-4a3a-a4f2-375e4e723085 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:00.070554 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-25b812a2-ed3e-4a3a-a4f2-375e4e723085 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:00.153859 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.wsgi [None req-25b812a2-ed3e-4a3a-a4f2-375e4e723085 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] HTTP exception thrown: Invalid volume: volume cf26a4e7-7ae1-4293-995c-18d979dae53f is already attached to instances: beb4b4d2-0edd-494b-958c-72c59082d35e Jul 12 14:50:00.155634 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-25b812a2-ed3e-4a3a-a4f2-375e4e723085 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Request method failure captured: Jul 12 14:50:00.155634 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: POST /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627/os-volume_attachments HTTP/1.1 Jul 12 14:50:00.155634 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:50:00.155634 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:50:00.155634 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:50:00.155634 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 74 Jul 12 14:50:00.155634 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:50:00.155634 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:50:00.155634 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:50:00.155634 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:50:00.155634 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYl36fzTwFtVGKGnuLeWSR2xyzHWwW-MuDxWxaXdj_iqJqN47gaidjWXHzGJk8xWf-7iIhGkO1yM8AnekzxjKftE8wUnGgFJsehPH1UO-4j29uRFi6cowSALtK5HCNwfqNyHXXw02fXyxBOCZ4tFJOEbNcuLcZWDT9MpBcZT-ODszdo Jul 12 14:50:00.155634 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:50:00.155634 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:50:00.155634 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:50:00.155634 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:50:00.155634 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:50:00.155634 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:50:00.155634 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: 35438fec2e37438e99201870e0d650af Jul 12 14:50:00.155634 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:50:00.155634 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:50:00.155634 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:50:00.157063 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35438fec2e37438e99201870e0d650af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/35438fec2e37438e99201870e0d650af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35438fec2e37438e99201870e0d650af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_35438fec2e37438e99201870e0d650af", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:50:00.157063 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:50:00.157063 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: 35438fec2e37438e99201870e0d650af Jul 12 14:50:00.157063 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:50:00.157063 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-AttachVolumeNegativeTest-1692963561-project Jul 12 14:50:00.157063 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:50:00.157063 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:50:00.157063 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: f926d674e2dc4eb58d7fe6379b79310b Jul 12 14:50:00.157063 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-AttachVolumeNegativeTest-1692963561-project Jul 12 14:50:00.157063 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Jul 12 14:50:00.157063 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {"volumeAttachment": {"volumeId": "cf26a4e7-7ae1-4293-995c-18d979dae53f"}} Jul 12 14:50:00.157063 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: > Jul 12 14:50:00.158059 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Invalid volume: volume cf26a4e7-7ae1-4293-995c-18d979dae53f is already attached to instances: beb4b4d2-0edd-494b-958c-72c59082d35e Jul 12 14:50:00.158059 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'server_id': '4370218b-d99a-4484-829d-ffa09e867627', 'body': {'volumeAttachment': {'volumeId': 'cf26a4e7-7ae1-4293-995c-18d979dae53f'}}} Jul 12 14:50:00.158059 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:50:00.158059 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:50:00.158059 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 14:50:00.158059 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 14:50:00.158059 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 14:50:00.158059 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 14:50:00.158059 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 12 14:50:00.158059 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 14:50:00.158059 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 12 14:50:00.158059 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 12 14:50:00.158059 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 12 14:50:00.158059 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 12 14:50:00.158059 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cf26a4e7-7ae1-4293-995c-18d979dae53f is already attached to instances: beb4b4d2-0edd-494b-958c-72c59082d35e Jul 12 14:50:00.158059 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:50:00.158059 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:50:00.158059 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:50:00.158059 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:50:00.159541 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:50:00.159541 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:50:00.159541 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:50:00.159541 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:50:00.159541 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:50:00.159541 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:50:00.159541 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 14:50:00.159541 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 14:50:00.159541 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 14:50:00.159541 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 14:50:00.159541 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 14:50:00.159541 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 14:50:00.159541 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 12 14:50:00.159541 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 12 14:50:00.159541 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cf26a4e7-7ae1-4293-995c-18d979dae53f is already attached to instances: beb4b4d2-0edd-494b-958c-72c59082d35e Jul 12 14:50:00.159541 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:50:00.159541 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:50:00.159541 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:50:00.159541 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:50:00.159541 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:50:00.161032 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:50:00.161032 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:50:00.161032 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:50:00.161032 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cf26a4e7-7ae1-4293-995c-18d979dae53f is already attached to instances: beb4b4d2-0edd-494b-958c-72c59082d35e Jul 12 14:50:00.161032 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:50:00.161032 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-25b812a2-ed3e-4a3a-a4f2-375e4e723085 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Returning 400 to user: Invalid volume: volume cf26a4e7-7ae1-4293-995c-18d979dae53f is already attached to instances: beb4b4d2-0edd-494b-958c-72c59082d35e {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:50:00.161032 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-25b812a2-ed3e-4a3a-a4f2-375e4e723085 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "POST /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102652 Jul 12 14:50:00.161032 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 553/1106] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Jul 12 14:50:00 2022] POST /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 14:50:00.166077 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-68f0ad73-5cfb-4ba3-8098-b3526910525e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:00.166661 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-68f0ad73-5cfb-4ba3-8098-b3526910525e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:00.174139 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-68f0ad73-5cfb-4ba3-8098-b3526910525e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:00.174609 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-68f0ad73-5cfb-4ba3-8098-b3526910525e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:00.175318 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-68f0ad73-5cfb-4ba3-8098-b3526910525e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:00.175695 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-68f0ad73-5cfb-4ba3-8098-b3526910525e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:00.200582 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-68f0ad73-5cfb-4ba3-8098-b3526910525e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Going to try to terminate instance {{(pid=129980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:50:00.493742 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-68f0ad73-5cfb-4ba3-8098-b3526910525e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627" status: 204 len: 0 microversion: 2.1 time: 0.331607 Jul 12 14:50:00.494315 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 554/1107] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Jul 12 14:50:00 2022] DELETE /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:50:00.502352 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-570d3e3f-d413-4c1f-8d8f-3120f9be5d4c tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:00.502969 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-570d3e3f-d413-4c1f-8d8f-3120f9be5d4c tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:00.510042 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-570d3e3f-d413-4c1f-8d8f-3120f9be5d4c tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:00.510549 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-570d3e3f-d413-4c1f-8d8f-3120f9be5d4c tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:00.511316 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-570d3e3f-d413-4c1f-8d8f-3120f9be5d4c tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:00.511752 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-570d3e3f-d413-4c1f-8d8f-3120f9be5d4c tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:00.649587 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-570d3e3f-d413-4c1f-8d8f-3120f9be5d4c tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:50:00.657401 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-570d3e3f-d413-4c1f-8d8f-3120f9be5d4c tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627" status: 200 len: 1680 microversion: 2.1 time: 0.158890 Jul 12 14:50:00.657986 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 554/1108] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:50:00 2022] GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:50:01.675958 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-6de3d150-a3a4-497f-964a-ecbefb92d4ba tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:01.676623 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-6de3d150-a3a4-497f-964a-ecbefb92d4ba tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:01.683075 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6de3d150-a3a4-497f-964a-ecbefb92d4ba tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:01.683769 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6de3d150-a3a4-497f-964a-ecbefb92d4ba tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:01.684286 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6de3d150-a3a4-497f-964a-ecbefb92d4ba tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:01.684727 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6de3d150-a3a4-497f-964a-ecbefb92d4ba tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:01.816324 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-6de3d150-a3a4-497f-964a-ecbefb92d4ba tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:50:01.823856 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-6de3d150-a3a4-497f-964a-ecbefb92d4ba tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627" status: 200 len: 1680 microversion: 2.1 time: 0.152253 Jul 12 14:50:01.825067 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 555/1109] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:50:01 2022] GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:50:02.841032 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-0e73a149-4112-4b12-b17a-c6bafbf54e35 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:02.841687 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-0e73a149-4112-4b12-b17a-c6bafbf54e35 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:02.847886 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0e73a149-4112-4b12-b17a-c6bafbf54e35 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:02.848338 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0e73a149-4112-4b12-b17a-c6bafbf54e35 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:02.849120 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0e73a149-4112-4b12-b17a-c6bafbf54e35 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:02.849602 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0e73a149-4112-4b12-b17a-c6bafbf54e35 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:03.197850 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-0e73a149-4112-4b12-b17a-c6bafbf54e35 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:50:03.205544 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-0e73a149-4112-4b12-b17a-c6bafbf54e35 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627" status: 200 len: 1680 microversion: 2.1 time: 0.368534 Jul 12 14:50:03.206228 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 555/1110] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:50:02 2022] GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 => generated 1680 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:50:03.922369 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-ff3f0081-5403-482f-b358-82576e5923c2 req-b5bc854c-8a8a-4724-8598-0e91d81f772c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4370218b-d99a-4484-829d-ffa09e867627", "name": "network-vif-deleted", "tag": "fd4499b0-8818-4d57-aba9-bed0b1f2686e"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:50:03.931393 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-ff3f0081-5403-482f-b358-82576e5923c2 req-b5bc854c-8a8a-4724-8598-0e91d81f772c service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:03.931842 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-ff3f0081-5403-482f-b358-82576e5923c2 req-b5bc854c-8a8a-4724-8598-0e91d81f772c service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:03.942854 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-ff3f0081-5403-482f-b358-82576e5923c2 req-b5bc854c-8a8a-4724-8598-0e91d81f772c service nova] Creating event network-vif-deleted:fd4499b0-8818-4d57-aba9-bed0b1f2686e for instance 4370218b-d99a-4484-829d-ffa09e867627 on hv-cinder-82002 Jul 12 14:50:03.948264 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-ff3f0081-5403-482f-b358-82576e5923c2 req-b5bc854c-8a8a-4724-8598-0e91d81f772c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030566 Jul 12 14:50:03.949034 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 556/1111] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:50:04.223384 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c00f1fd7-dc96-43f6-9cb6-309607142376 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:04.224707 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-c00f1fd7-dc96-43f6-9cb6-309607142376 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:04.232371 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c00f1fd7-dc96-43f6-9cb6-309607142376 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:04.236888 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c00f1fd7-dc96-43f6-9cb6-309607142376 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:04.237991 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c00f1fd7-dc96-43f6-9cb6-309607142376 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:04.238644 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c00f1fd7-dc96-43f6-9cb6-309607142376 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:04.286762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c00f1fd7-dc96-43f6-9cb6-309607142376 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:04.287364 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c00f1fd7-dc96-43f6-9cb6-309607142376 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:04.287931 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.objects.instance [None req-c00f1fd7-dc96-43f6-9cb6-309607142376 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lazy-loading 'fault' on Instance uuid 4370218b-d99a-4484-829d-ffa09e867627 {{(pid=129981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:50:04.336928 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c00f1fd7-dc96-43f6-9cb6-309607142376 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:50:04.344866 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-c00f1fd7-dc96-43f6-9cb6-309607142376 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627" status: 200 len: 1332 microversion: 2.1 time: 0.125339 Jul 12 14:50:04.345477 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 556/1112] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:50:04 2022] GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 => generated 1332 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:50:05.362892 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0e463a7a-4f99-4b02-b29e-fc8ba7912535 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:05.363590 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-0e463a7a-4f99-4b02-b29e-fc8ba7912535 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:05.370998 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0e463a7a-4f99-4b02-b29e-fc8ba7912535 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:05.371445 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0e463a7a-4f99-4b02-b29e-fc8ba7912535 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:05.372208 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0e463a7a-4f99-4b02-b29e-fc8ba7912535 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:05.372710 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0e463a7a-4f99-4b02-b29e-fc8ba7912535 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:05.387060 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.wsgi [None req-0e463a7a-4f99-4b02-b29e-fc8ba7912535 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] HTTP exception thrown: Instance 4370218b-d99a-4484-829d-ffa09e867627 could not be found. Jul 12 14:50:05.388692 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0e463a7a-4f99-4b02-b29e-fc8ba7912535 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Request method failure captured: Jul 12 14:50:05.388692 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: request: GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 HTTP/1.1 Jul 12 14:50:05.388692 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept: application/json Jul 12 14:50:05.388692 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept-Encoding: identity Jul 12 14:50:05.388692 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Connection: close Jul 12 14:50:05.388692 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Length: 0 Jul 12 14:50:05.388692 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Type: application/json Jul 12 14:50:05.388692 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Host: 10.222.0.30 Jul 12 14:50:05.388692 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Openstack-System-Scope: None Jul 12 14:50:05.388692 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: User-Agent: python-urllib3/1.26.9 Jul 12 14:50:05.388692 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Auth-Token: gAAAAABizYl36fzTwFtVGKGnuLeWSR2xyzHWwW-MuDxWxaXdj_iqJqN47gaidjWXHzGJk8xWf-7iIhGkO1yM8AnekzxjKftE8wUnGgFJsehPH1UO-4j29uRFi6cowSALtK5HCNwfqNyHXXw02fXyxBOCZ4tFJOEbNcuLcZWDT9MpBcZT-ODszdo Jul 12 14:50:05.388692 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Id: None Jul 12 14:50:05.388692 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Name: None Jul 12 14:50:05.388692 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Identity-Status: Confirmed Jul 12 14:50:05.388692 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Is-Admin-Project: True Jul 12 14:50:05.388692 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Id: default Jul 12 14:50:05.388692 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Name: Default Jul 12 14:50:05.388692 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Id: 35438fec2e37438e99201870e0d650af Jul 12 14:50:05.388692 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Name: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:50:05.388692 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Role: member,reader Jul 12 14:50:05.388692 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Roles: member,reader Jul 12 14:50:05.390451 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35438fec2e37438e99201870e0d650af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/35438fec2e37438e99201870e0d650af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35438fec2e37438e99201870e0d650af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_35438fec2e37438e99201870e0d650af", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:50:05.390451 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:50:05.390451 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Id: 35438fec2e37438e99201870e0d650af Jul 12 14:50:05.390451 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:50:05.390451 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User: tempest-AttachVolumeNegativeTest-1692963561-project Jul 12 14:50:05.390451 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Id: default Jul 12 14:50:05.390451 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Name: Default Jul 12 14:50:05.390451 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Id: f926d674e2dc4eb58d7fe6379b79310b Jul 12 14:50:05.390451 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Name: tempest-AttachVolumeNegativeTest-1692963561-project Jul 12 14:50:05.390451 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: method: > Jul 12 14:50:05.390451 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: exception: Instance 4370218b-d99a-4484-829d-ffa09e867627 could not be found. Jul 12 14:50:05.390451 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: action_args: {'id': '4370218b-d99a-4484-829d-ffa09e867627'} Jul 12 14:50:05.391415 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:50:05.391415 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:50:05.391415 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:50:05.391415 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:50:05.391415 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:50:05.391415 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:50:05.391415 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:50:05.391415 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:50:05.391415 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:50:05.391415 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:50:05.391415 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4370218b-d99a-4484-829d-ffa09e867627 could not be found. Jul 12 14:50:05.391415 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:50:05.391415 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:50:05.391415 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:50:05.391415 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:50:05.391415 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:50:05.391415 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:50:05.391415 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:50:05.391415 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:50:05.391415 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:50:05.393044 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:50:05.393044 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:50:05.393044 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:50:05.393044 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:50:05.393044 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:50:05.393044 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:50:05.393044 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:50:05.393044 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4370218b-d99a-4484-829d-ffa09e867627 could not be found. Jul 12 14:50:05.393044 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:50:05.393044 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:50:05.393044 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:50:05.393044 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:50:05.393044 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:50:05.393044 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:50:05.393044 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:50:05.393044 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:50:05.393044 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4370218b-d99a-4484-829d-ffa09e867627 could not be found. Jul 12 14:50:05.393044 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:50:05.394489 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0e463a7a-4f99-4b02-b29e-fc8ba7912535 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Returning 404 to user: Instance 4370218b-d99a-4484-829d-ffa09e867627 could not be found. {{(pid=129980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:50:05.394489 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-0e463a7a-4f99-4b02-b29e-fc8ba7912535 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627" status: 404 len: 111 microversion: 2.1 time: 0.031942 Jul 12 14:50:05.394489 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 557/1113] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:50:05 2022] GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:50:05.401819 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-24fde9a8-0f20-4e3d-9faa-c56ffe3ad971 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '.version_select at 0x7f962d61f280>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:05.509731 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-24fde9a8-0f20-4e3d-9faa-c56ffe3ad971 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1511733818" status: 202 len: 0 microversion: 2.1 time: 0.114498 Jul 12 14:50:05.510323 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 557/1114] 10.222.0.30 () {58 vars in 1220 bytes} [Tue Jul 12 14:50:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1511733818 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:50:06.321816 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-9431a463-3599-479c-a65f-1080092a622e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:06.322317 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-9431a463-3599-479c-a65f-1080092a622e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:06.328397 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9431a463-3599-479c-a65f-1080092a622e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:06.328857 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9431a463-3599-479c-a65f-1080092a622e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:06.329673 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9431a463-3599-479c-a65f-1080092a622e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:06.330115 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9431a463-3599-479c-a65f-1080092a622e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:06.416963 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.objects.instance [None req-9431a463-3599-479c-a65f-1080092a622e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lazy-loading 'services' on Instance uuid beb4b4d2-0edd-494b-958c-72c59082d35e {{(pid=129980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:50:06.606794 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-9431a463-3599-479c-a65f-1080092a622e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "DELETE /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e/os-volume_attachments/cf26a4e7-7ae1-4293-995c-18d979dae53f" status: 202 len: 0 microversion: 2.1 time: 0.288691 Jul 12 14:50:06.607372 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 558/1115] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Jul 12 14:50:06 2022] DELETE /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e/os-volume_attachments/cf26a4e7-7ae1-4293-995c-18d979dae53f => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:50:06.616950 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-76b41984-aedc-41fa-a729-a381d2b2f231 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:06.617970 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-76b41984-aedc-41fa-a729-a381d2b2f231 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:06.624771 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-76b41984-aedc-41fa-a729-a381d2b2f231 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:06.625243 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-76b41984-aedc-41fa-a729-a381d2b2f231 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:06.625999 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-76b41984-aedc-41fa-a729-a381d2b2f231 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:06.626434 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-76b41984-aedc-41fa-a729-a381d2b2f231 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:06.656206 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-76b41984-aedc-41fa-a729-a381d2b2f231 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044551 Jul 12 14:50:06.656835 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 558/1116] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Jul 12 14:50:06 2022] GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:50:07.669512 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-affb5d07-0a7f-4239-987f-b6bd22b3fe67 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:07.670475 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-affb5d07-0a7f-4239-987f-b6bd22b3fe67 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:07.676660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-affb5d07-0a7f-4239-987f-b6bd22b3fe67 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:07.677102 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-affb5d07-0a7f-4239-987f-b6bd22b3fe67 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:07.677952 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-affb5d07-0a7f-4239-987f-b6bd22b3fe67 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:07.678386 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-affb5d07-0a7f-4239-987f-b6bd22b3fe67 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:07.706098 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-affb5d07-0a7f-4239-987f-b6bd22b3fe67 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041430 Jul 12 14:50:07.706634 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 559/1117] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Jul 12 14:50:07 2022] GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:50:08.717315 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-7a706ed9-f174-4a8b-aee2-6dc8a9cf2eb0 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:08.718169 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-7a706ed9-f174-4a8b-aee2-6dc8a9cf2eb0 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:08.724747 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7a706ed9-f174-4a8b-aee2-6dc8a9cf2eb0 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:08.725233 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7a706ed9-f174-4a8b-aee2-6dc8a9cf2eb0 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:08.726008 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7a706ed9-f174-4a8b-aee2-6dc8a9cf2eb0 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:08.726451 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-7a706ed9-f174-4a8b-aee2-6dc8a9cf2eb0 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:08.761293 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-7a706ed9-f174-4a8b-aee2-6dc8a9cf2eb0 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047820 Jul 12 14:50:08.762130 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 559/1118] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Jul 12 14:50:08 2022] GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 14:50:08.819725 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-b4eb5469-10a2-4c9e-9676-e80cf271f9d8 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:08.820222 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-b4eb5469-10a2-4c9e-9676-e80cf271f9d8 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:08.826677 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b4eb5469-10a2-4c9e-9676-e80cf271f9d8 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:08.827132 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b4eb5469-10a2-4c9e-9676-e80cf271f9d8 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:08.827923 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b4eb5469-10a2-4c9e-9676-e80cf271f9d8 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:08.828365 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b4eb5469-10a2-4c9e-9676-e80cf271f9d8 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:08.853188 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-b4eb5469-10a2-4c9e-9676-e80cf271f9d8 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Going to try to terminate instance {{(pid=129980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:50:09.110953 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-b4eb5469-10a2-4c9e-9676-e80cf271f9d8 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "DELETE /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e" status: 204 len: 0 microversion: 2.1 time: 0.294640 Jul 12 14:50:09.111464 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 560/1119] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Jul 12 14:50:08 2022] DELETE /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:50:09.120091 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-46257182-eeaf-4d13-bf37-bdf5e09be841 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:09.120750 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-46257182-eeaf-4d13-bf37-bdf5e09be841 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:09.126904 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-46257182-eeaf-4d13-bf37-bdf5e09be841 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:09.127349 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-46257182-eeaf-4d13-bf37-bdf5e09be841 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:09.128113 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-46257182-eeaf-4d13-bf37-bdf5e09be841 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:09.128549 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-46257182-eeaf-4d13-bf37-bdf5e09be841 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:09.255605 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-46257182-eeaf-4d13-bf37-bdf5e09be841 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:50:09.263035 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-46257182-eeaf-4d13-bf37-bdf5e09be841 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e" status: 200 len: 1680 microversion: 2.1 time: 0.146803 Jul 12 14:50:09.263599 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 560/1120] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:50:09 2022] GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:50:10.280393 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-e2573c55-6ccb-4eef-a3b9-ef96d700976c tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:10.281103 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-e2573c55-6ccb-4eef-a3b9-ef96d700976c tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:10.287753 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e2573c55-6ccb-4eef-a3b9-ef96d700976c tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:10.288209 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e2573c55-6ccb-4eef-a3b9-ef96d700976c tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:10.288976 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e2573c55-6ccb-4eef-a3b9-ef96d700976c tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:10.289451 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e2573c55-6ccb-4eef-a3b9-ef96d700976c tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:10.418378 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-e2573c55-6ccb-4eef-a3b9-ef96d700976c tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:50:10.426001 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-e2573c55-6ccb-4eef-a3b9-ef96d700976c tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e" status: 200 len: 1680 microversion: 2.1 time: 0.149865 Jul 12 14:50:10.426560 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 561/1121] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:50:10 2022] GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:50:11.444167 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-2c02ab5e-be21-4332-9929-7848328b4c2c tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:11.444167 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-2c02ab5e-be21-4332-9929-7848328b4c2c tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:11.451592 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2c02ab5e-be21-4332-9929-7848328b4c2c tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:11.452040 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2c02ab5e-be21-4332-9929-7848328b4c2c tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:11.452826 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2c02ab5e-be21-4332-9929-7848328b4c2c tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:11.453292 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2c02ab5e-be21-4332-9929-7848328b4c2c tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:11.621444 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-2c02ab5e-be21-4332-9929-7848328b4c2c tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:50:11.630813 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-2c02ab5e-be21-4332-9929-7848328b4c2c tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e" status: 200 len: 1680 microversion: 2.1 time: 0.191234 Jul 12 14:50:11.631389 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 561/1122] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:50:11 2022] GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e => generated 1680 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:50:12.101283 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-75d9580e-932f-435a-a62f-7e645e86d7c3 req-b3f8f00f-746b-4fc9-b630-8d64d7915a5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beb4b4d2-0edd-494b-958c-72c59082d35e", "name": "network-vif-deleted", "tag": "84a8a16c-7c5d-4a9f-9c5b-153879673de1"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:50:12.120042 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-75d9580e-932f-435a-a62f-7e645e86d7c3 req-b3f8f00f-746b-4fc9-b630-8d64d7915a5b service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:12.120829 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-75d9580e-932f-435a-a62f-7e645e86d7c3 req-b3f8f00f-746b-4fc9-b630-8d64d7915a5b service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:12.133643 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-75d9580e-932f-435a-a62f-7e645e86d7c3 req-b3f8f00f-746b-4fc9-b630-8d64d7915a5b service nova] Creating event network-vif-deleted:84a8a16c-7c5d-4a9f-9c5b-153879673de1 for instance beb4b4d2-0edd-494b-958c-72c59082d35e on hv-cinder-82002 Jul 12 14:50:12.139230 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-75d9580e-932f-435a-a62f-7e645e86d7c3 req-b3f8f00f-746b-4fc9-b630-8d64d7915a5b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.256311 Jul 12 14:50:12.140707 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 562/1123] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:50:12.648132 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e4df8953-3d66-417b-be1f-82e4c0b9d4dd tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:12.648743 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-e4df8953-3d66-417b-be1f-82e4c0b9d4dd tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:12.655376 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e4df8953-3d66-417b-be1f-82e4c0b9d4dd tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:12.655835 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e4df8953-3d66-417b-be1f-82e4c0b9d4dd tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:12.656623 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e4df8953-3d66-417b-be1f-82e4c0b9d4dd tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:12.657189 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e4df8953-3d66-417b-be1f-82e4c0b9d4dd tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:12.692915 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e4df8953-3d66-417b-be1f-82e4c0b9d4dd tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:12.694523 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e4df8953-3d66-417b-be1f-82e4c0b9d4dd tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:12.695010 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.objects.instance [None req-e4df8953-3d66-417b-be1f-82e4c0b9d4dd tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lazy-loading 'fault' on Instance uuid beb4b4d2-0edd-494b-958c-72c59082d35e {{(pid=129981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:50:12.740293 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e4df8953-3d66-417b-be1f-82e4c0b9d4dd tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:50:12.748212 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-e4df8953-3d66-417b-be1f-82e4c0b9d4dd tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e" status: 200 len: 1330 microversion: 2.1 time: 0.104542 Jul 12 14:50:12.751382 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 562/1124] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:50:12 2022] GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e => generated 1330 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:50:13.771679 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ff340990-a3d5-4309-ab90-7868c26c0001 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:13.772377 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-ff340990-a3d5-4309-ab90-7868c26c0001 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:13.778799 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ff340990-a3d5-4309-ab90-7868c26c0001 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:13.779252 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ff340990-a3d5-4309-ab90-7868c26c0001 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:13.780010 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ff340990-a3d5-4309-ab90-7868c26c0001 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:13.780447 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ff340990-a3d5-4309-ab90-7868c26c0001 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:13.793672 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.wsgi [None req-ff340990-a3d5-4309-ab90-7868c26c0001 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] HTTP exception thrown: Instance beb4b4d2-0edd-494b-958c-72c59082d35e could not be found. Jul 12 14:50:13.795307 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ff340990-a3d5-4309-ab90-7868c26c0001 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Request method failure captured: Jul 12 14:50:13.795307 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: request: GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e HTTP/1.1 Jul 12 14:50:13.795307 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept: application/json Jul 12 14:50:13.795307 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept-Encoding: identity Jul 12 14:50:13.795307 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Connection: close Jul 12 14:50:13.795307 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Length: 0 Jul 12 14:50:13.795307 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Type: application/json Jul 12 14:50:13.795307 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Host: 10.222.0.30 Jul 12 14:50:13.795307 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Openstack-System-Scope: None Jul 12 14:50:13.795307 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: User-Agent: python-urllib3/1.26.9 Jul 12 14:50:13.795307 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Auth-Token: gAAAAABizYl36fzTwFtVGKGnuLeWSR2xyzHWwW-MuDxWxaXdj_iqJqN47gaidjWXHzGJk8xWf-7iIhGkO1yM8AnekzxjKftE8wUnGgFJsehPH1UO-4j29uRFi6cowSALtK5HCNwfqNyHXXw02fXyxBOCZ4tFJOEbNcuLcZWDT9MpBcZT-ODszdo Jul 12 14:50:13.795307 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Id: None Jul 12 14:50:13.795307 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Name: None Jul 12 14:50:13.795307 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Identity-Status: Confirmed Jul 12 14:50:13.795307 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Is-Admin-Project: True Jul 12 14:50:13.795307 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Id: default Jul 12 14:50:13.795307 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Name: Default Jul 12 14:50:13.795307 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Id: 35438fec2e37438e99201870e0d650af Jul 12 14:50:13.795307 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Name: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:50:13.795307 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Role: member,reader Jul 12 14:50:13.795307 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Roles: member,reader Jul 12 14:50:13.796932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35438fec2e37438e99201870e0d650af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/35438fec2e37438e99201870e0d650af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35438fec2e37438e99201870e0d650af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_35438fec2e37438e99201870e0d650af", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:50:13.796932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:50:13.796932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Id: 35438fec2e37438e99201870e0d650af Jul 12 14:50:13.796932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:50:13.796932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User: tempest-AttachVolumeNegativeTest-1692963561-project Jul 12 14:50:13.796932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Id: default Jul 12 14:50:13.796932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Name: Default Jul 12 14:50:13.796932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Id: f926d674e2dc4eb58d7fe6379b79310b Jul 12 14:50:13.796932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Name: tempest-AttachVolumeNegativeTest-1692963561-project Jul 12 14:50:13.796932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: method: > Jul 12 14:50:13.796932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: exception: Instance beb4b4d2-0edd-494b-958c-72c59082d35e could not be found. Jul 12 14:50:13.796932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: action_args: {'id': 'beb4b4d2-0edd-494b-958c-72c59082d35e'} Jul 12 14:50:13.800729 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:50:13.800729 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:50:13.800729 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:50:13.800729 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:50:13.800729 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:50:13.800729 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:50:13.800729 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:50:13.800729 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:50:13.800729 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:50:13.800729 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:50:13.800729 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beb4b4d2-0edd-494b-958c-72c59082d35e could not be found. Jul 12 14:50:13.800729 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:50:13.800729 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:50:13.800729 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:50:13.800729 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:50:13.800729 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:50:13.800729 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:50:13.800729 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:50:13.800729 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:50:13.800729 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:50:13.802282 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:50:13.802282 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:50:13.802282 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:50:13.802282 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:50:13.802282 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:50:13.802282 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:50:13.802282 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:50:13.802282 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beb4b4d2-0edd-494b-958c-72c59082d35e could not be found. Jul 12 14:50:13.802282 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:50:13.802282 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:50:13.802282 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:50:13.802282 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:50:13.802282 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:50:13.802282 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:50:13.802282 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:50:13.802282 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:50:13.802282 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beb4b4d2-0edd-494b-958c-72c59082d35e could not be found. Jul 12 14:50:13.802282 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:50:13.804156 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ff340990-a3d5-4309-ab90-7868c26c0001 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Returning 404 to user: Instance beb4b4d2-0edd-494b-958c-72c59082d35e could not be found. {{(pid=129980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:50:13.804156 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ff340990-a3d5-4309-ab90-7868c26c0001 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e" status: 404 len: 111 microversion: 2.1 time: 0.029724 Jul 12 14:50:13.804156 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 563/1125] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:50:13 2022] GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:50:13.806003 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-267afac3-47a9-463d-b0d0-dbd3f695fab9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '.version_select at 0x7f962c8af700>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:13.929348 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-267afac3-47a9-463d-b0d0-dbd3f695fab9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-821938727" status: 202 len: 0 microversion: 2.1 time: 0.127461 Jul 12 14:50:13.929934 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 563/1126] 10.222.0.30 () {58 vars in 1217 bytes} [Tue Jul 12 14:50:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-821938727 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:50:14.675651 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-fe4843c4-00d9-4794-9a20-7b62292a8dfa tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Action: 'create', calling method: .version_select at 0x7f962cb5db80>, body: {"keypair": {"name": "tempest-keypair-565611176", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKeSAlW0M2AFh69qvV01MY9wuMUhJblo8ylKtXCBdviV4DuIIQWlXmrJ5hoW3loGA8Fua1wb/kVPqtfszninojRTW6dn8OMEq2w4pxWf/grOySHhmoiMHytGq4WuOvJB7g=="}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:50:14.689455 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-fe4843c4-00d9-4794-9a20-7b62292a8dfa tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Getting quotas for project 35438fec2e37438e99201870e0d650af. Resources: {'key_pairs'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:50:14.693581 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-fe4843c4-00d9-4794-9a20-7b62292a8dfa tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Getting quotas for user f926d674e2dc4eb58d7fe6379b79310b and project 35438fec2e37438e99201870e0d650af. Resources: {'key_pairs'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:50:14.786209 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-fe4843c4-00d9-4794-9a20-7b62292a8dfa tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.114543 Jul 12 14:50:14.787313 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 564/1127] 10.222.0.30 () {60 vars in 1158 bytes} [Tue Jul 12 14:50:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:50:17.263697 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-2bccfd08-b915-4877-b20f-6f865ab4d198 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-12309206", "imageRef": "a66ccacb-7b1e-4f51-9eaf-069a356e0fdb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18dbd310-dea2-4429-9ee9-f4f77e3d7b99"}], "security_groups": [{"name": "tempest-securitygroup--1643238500"}], "key_name": "tempest-keypair-565611176", "user_data": "}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:50:17.364505 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.network.neutron [None req-2bccfd08-b915-4877-b20f-6f865ab4d198 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] validate_networks() for [('18dbd310-dea2-4429-9ee9-f4f77e3d7b99', None, None, None, None, None)] {{(pid=129981) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:50:17.988087 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-2bccfd08-b915-4877-b20f-6f865ab4d198 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Flavor limits 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:50:17.988508 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-2bccfd08-b915-4877-b20f-6f865ab4d198 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Image limits 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:50:17.988974 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-2bccfd08-b915-4877-b20f-6f865ab4d198 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Flavor pref 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:50:17.989411 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-2bccfd08-b915-4877-b20f-6f865ab4d198 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Image pref 0:0:0 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:50:17.989815 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.virt.hardware [None req-2bccfd08-b915-4877-b20f-6f865ab4d198 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:50:17.999247 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2bccfd08-b915-4877-b20f-6f865ab4d198 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:17.999669 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2bccfd08-b915-4877-b20f-6f865ab4d198 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:18.000457 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2bccfd08-b915-4877-b20f-6f865ab4d198 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:18.002051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2bccfd08-b915-4877-b20f-6f865ab4d198 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:18.017468 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.quota [None req-2bccfd08-b915-4877-b20f-6f865ab4d198 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Getting quotas for project 35438fec2e37438e99201870e0d650af. Resources: {'instances', 'cores', 'ram'} {{(pid=129981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:50:18.021280 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.quota [None req-2bccfd08-b915-4877-b20f-6f865ab4d198 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Getting quotas for user f926d674e2dc4eb58d7fe6379b79310b and project 35438fec2e37438e99201870e0d650af. Resources: {'instances', 'cores', 'ram'} {{(pid=129981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:50:18.031915 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-2bccfd08-b915-4877-b20f-6f865ab4d198 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Going to run 1 instances... {{(pid=129981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:50:18.034157 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-2bccfd08-b915-4877-b20f-6f865ab4d198 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a66ccacb-7b1e-4f51-9eaf-069a356e0fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:50:18.179687 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-2bccfd08-b915-4877-b20f-6f865ab4d198 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.920674 Jul 12 14:50:18.180456 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 564/1128] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Jul 12 14:50:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:50:18.190746 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-1b83c5bd-ee67-4018-b204-a93d5cb93b81 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:18.191350 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-1b83c5bd-ee67-4018-b204-a93d5cb93b81 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:18.255497 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-1b83c5bd-ee67-4018-b204-a93d5cb93b81 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:50:18.262191 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-1b83c5bd-ee67-4018-b204-a93d5cb93b81 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218" status: 200 len: 1239 microversion: 2.1 time: 0.075884 Jul 12 14:50:18.262760 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 565/1129] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:50:18 2022] GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 => generated 1239 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:50:19.279310 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-4592fbd8-50c6-4073-9bab-b5e3ae16bdc5 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:19.279929 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-4592fbd8-50c6-4073-9bab-b5e3ae16bdc5 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:19.287933 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4592fbd8-50c6-4073-9bab-b5e3ae16bdc5 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:19.288378 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4592fbd8-50c6-4073-9bab-b5e3ae16bdc5 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:19.289131 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4592fbd8-50c6-4073-9bab-b5e3ae16bdc5 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:19.289584 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4592fbd8-50c6-4073-9bab-b5e3ae16bdc5 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:19.350745 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-4592fbd8-50c6-4073-9bab-b5e3ae16bdc5 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:50:19.358242 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-4592fbd8-50c6-4073-9bab-b5e3ae16bdc5 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218" status: 200 len: 1243 microversion: 2.1 time: 0.082858 Jul 12 14:50:19.358804 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 565/1130] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:50:19 2022] GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 => generated 1243 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:50:20.375421 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-244e3df4-1819-45d8-940b-434576d34311 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:20.376035 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-244e3df4-1819-45d8-940b-434576d34311 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:20.382844 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-244e3df4-1819-45d8-940b-434576d34311 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:20.383296 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-244e3df4-1819-45d8-940b-434576d34311 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:20.384063 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-244e3df4-1819-45d8-940b-434576d34311 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:20.384501 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-244e3df4-1819-45d8-940b-434576d34311 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:20.463354 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-244e3df4-1819-45d8-940b-434576d34311 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:50:20.471216 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-244e3df4-1819-45d8-940b-434576d34311 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218" status: 200 len: 1299 microversion: 2.1 time: 0.099636 Jul 12 14:50:20.471796 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 566/1131] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:50:20 2022] GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 => generated 1299 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:50:21.498177 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-932115c3-91a0-49f4-87f7-755be70eb0c9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:21.498812 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-932115c3-91a0-49f4-87f7-755be70eb0c9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:21.506505 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-932115c3-91a0-49f4-87f7-755be70eb0c9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:21.506780 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-932115c3-91a0-49f4-87f7-755be70eb0c9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:21.507555 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-932115c3-91a0-49f4-87f7-755be70eb0c9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:21.507997 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-932115c3-91a0-49f4-87f7-755be70eb0c9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:21.748314 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-932115c3-91a0-49f4-87f7-755be70eb0c9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:50:21.756174 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-932115c3-91a0-49f4-87f7-755be70eb0c9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218" status: 200 len: 1365 microversion: 2.1 time: 0.271116 Jul 12 14:50:21.757441 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 566/1132] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:50:21 2022] GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 => generated 1365 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:50:22.399469 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-6b58af31-f30c-4bbd-91e6-c0fc63dc6145 req-f8e83222-ead6-47a3-9063-1e5910549dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae44ec45-2b42-4f9e-8df7-e6a7c4c70218", "tag": "2307d55e-97a3-4d99-963a-037ad1913986"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:50:22.409269 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-6b58af31-f30c-4bbd-91e6-c0fc63dc6145 req-f8e83222-ead6-47a3-9063-1e5910549dd6 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:22.409717 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-6b58af31-f30c-4bbd-91e6-c0fc63dc6145 req-f8e83222-ead6-47a3-9063-1e5910549dd6 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:22.421609 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-6b58af31-f30c-4bbd-91e6-c0fc63dc6145 req-f8e83222-ead6-47a3-9063-1e5910549dd6 service nova] Creating event network-changed:2307d55e-97a3-4d99-963a-037ad1913986 for instance ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 on hv-cinder-82002 Jul 12 14:50:22.426909 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-6b58af31-f30c-4bbd-91e6-c0fc63dc6145 req-f8e83222-ead6-47a3-9063-1e5910549dd6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032150 Jul 12 14:50:22.427649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 567/1133] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:50:22.773043 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-9bd9a355-670d-4bbb-bf49-33fa7c44328d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:22.773675 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-9bd9a355-670d-4bbb-bf49-33fa7c44328d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:22.780093 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9bd9a355-670d-4bbb-bf49-33fa7c44328d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:22.780545 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9bd9a355-670d-4bbb-bf49-33fa7c44328d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:22.781335 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9bd9a355-670d-4bbb-bf49-33fa7c44328d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:22.781762 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-9bd9a355-670d-4bbb-bf49-33fa7c44328d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:22.998769 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-9bd9a355-670d-4bbb-bf49-33fa7c44328d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:50:23.007097 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-9bd9a355-670d-4bbb-bf49-33fa7c44328d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218" status: 200 len: 1365 microversion: 2.1 time: 0.237850 Jul 12 14:50:23.008142 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 567/1134] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:50:22 2022] GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:50:24.023945 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-89efbc5d-2908-46ec-8728-352f42680b26 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:24.024637 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-89efbc5d-2908-46ec-8728-352f42680b26 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:24.031018 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-89efbc5d-2908-46ec-8728-352f42680b26 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:24.031467 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-89efbc5d-2908-46ec-8728-352f42680b26 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:24.032235 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-89efbc5d-2908-46ec-8728-352f42680b26 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:24.032701 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-89efbc5d-2908-46ec-8728-352f42680b26 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:24.171701 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-89efbc5d-2908-46ec-8728-352f42680b26 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:50:24.179560 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-89efbc5d-2908-46ec-8728-352f42680b26 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218" status: 200 len: 1365 microversion: 2.1 time: 0.160144 Jul 12 14:50:24.180128 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 568/1135] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:50:24 2022] GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:50:25.195880 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-0bfb7dd3-ff30-4244-812d-a4033abffcd5 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:25.196535 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-0bfb7dd3-ff30-4244-812d-a4033abffcd5 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:25.204085 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0bfb7dd3-ff30-4244-812d-a4033abffcd5 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:25.204538 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0bfb7dd3-ff30-4244-812d-a4033abffcd5 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:25.205350 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0bfb7dd3-ff30-4244-812d-a4033abffcd5 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:25.205786 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0bfb7dd3-ff30-4244-812d-a4033abffcd5 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:25.333075 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-0bfb7dd3-ff30-4244-812d-a4033abffcd5 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:50:25.341171 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-0bfb7dd3-ff30-4244-812d-a4033abffcd5 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218" status: 200 len: 1365 microversion: 2.1 time: 0.149212 Jul 12 14:50:25.341744 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 568/1136] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:50:25 2022] GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:50:26.357181 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-93725457-6034-4f58-9824-be789f8bbc37 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:26.357833 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-93725457-6034-4f58-9824-be789f8bbc37 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:26.364340 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-93725457-6034-4f58-9824-be789f8bbc37 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:26.365340 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-93725457-6034-4f58-9824-be789f8bbc37 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:26.366108 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-93725457-6034-4f58-9824-be789f8bbc37 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:26.366542 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-93725457-6034-4f58-9824-be789f8bbc37 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:26.498627 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-93725457-6034-4f58-9824-be789f8bbc37 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:50:26.506906 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-93725457-6034-4f58-9824-be789f8bbc37 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218" status: 200 len: 1365 microversion: 2.1 time: 0.153658 Jul 12 14:50:26.507473 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 569/1137] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:50:26 2022] GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:50:27.524174 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-6d2daa3d-bf9c-4bef-a685-41b96025f065 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:27.524785 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-6d2daa3d-bf9c-4bef-a685-41b96025f065 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:27.531310 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6d2daa3d-bf9c-4bef-a685-41b96025f065 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:27.531759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6d2daa3d-bf9c-4bef-a685-41b96025f065 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:27.532516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6d2daa3d-bf9c-4bef-a685-41b96025f065 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:27.532951 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6d2daa3d-bf9c-4bef-a685-41b96025f065 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:27.659163 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-6d2daa3d-bf9c-4bef-a685-41b96025f065 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:50:27.667091 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-6d2daa3d-bf9c-4bef-a685-41b96025f065 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218" status: 200 len: 1365 microversion: 2.1 time: 0.147460 Jul 12 14:50:27.667654 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 569/1138] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:50:27 2022] GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:50:28.259560 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell0:SELECT=6 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:28.287398 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-183a6b7b-55cc-4621-b634-1b60da5ee567 req-fc0a4f7b-4095-4a4c-ad34-7f30ff8525bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae44ec45-2b42-4f9e-8df7-e6a7c4c70218", "name": "network-vif-plugged", "status": "completed", "tag": "2307d55e-97a3-4d99-963a-037ad1913986"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:50:28.295306 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-183a6b7b-55cc-4621-b634-1b60da5ee567 req-fc0a4f7b-4095-4a4c-ad34-7f30ff8525bf service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:28.295743 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-183a6b7b-55cc-4621-b634-1b60da5ee567 req-fc0a4f7b-4095-4a4c-ad34-7f30ff8525bf service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:28.306836 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-183a6b7b-55cc-4621-b634-1b60da5ee567 req-fc0a4f7b-4095-4a4c-ad34-7f30ff8525bf service nova] Creating event network-vif-plugged:2307d55e-97a3-4d99-963a-037ad1913986 for instance ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 on hv-cinder-82002 Jul 12 14:50:28.312326 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-183a6b7b-55cc-4621-b634-1b60da5ee567 req-fc0a4f7b-4095-4a4c-ad34-7f30ff8525bf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089811 Jul 12 14:50:28.312911 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 570/1139] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:50:28.683960 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-2369dd3a-fd1e-4fc4-a95c-212b631d0995 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:28.684591 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-2369dd3a-fd1e-4fc4-a95c-212b631d0995 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:28.686469 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell0:SELECT=2 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:28.687133 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell0:SELECT=6 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:28.692399 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2369dd3a-fd1e-4fc4-a95c-212b631d0995 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:28.692900 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2369dd3a-fd1e-4fc4-a95c-212b631d0995 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:28.693680 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2369dd3a-fd1e-4fc4-a95c-212b631d0995 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:28.694115 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2369dd3a-fd1e-4fc4-a95c-212b631d0995 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:28.863807 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-2369dd3a-fd1e-4fc4-a95c-212b631d0995 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:50:28.871201 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-2369dd3a-fd1e-4fc4-a95c-212b631d0995 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218" status: 200 len: 1365 microversion: 2.1 time: 0.191167 Jul 12 14:50:28.871766 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 570/1140] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:50:28 2022] GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:50:29.888727 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-1ccf284b-6681-4c52-b217-5d8c7e806db1 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:29.889406 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-1ccf284b-6681-4c52-b217-5d8c7e806db1 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:29.897046 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1ccf284b-6681-4c52-b217-5d8c7e806db1 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:29.897520 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1ccf284b-6681-4c52-b217-5d8c7e806db1 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:29.898272 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1ccf284b-6681-4c52-b217-5d8c7e806db1 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:29.898783 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-1ccf284b-6681-4c52-b217-5d8c7e806db1 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:30.025944 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-1ccf284b-6681-4c52-b217-5d8c7e806db1 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:50:30.029477 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:30.033751 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-1ccf284b-6681-4c52-b217-5d8c7e806db1 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218" status: 200 len: 1365 microversion: 2.1 time: 0.149280 Jul 12 14:50:30.034318 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 571/1141] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:50:29 2022] GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:50:31.050256 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-1800c76f-f1a6-4ef9-bb43-17c334e316c9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:31.050832 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-1800c76f-f1a6-4ef9-bb43-17c334e316c9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:31.053418 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:31.058233 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1800c76f-f1a6-4ef9-bb43-17c334e316c9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:31.058688 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1800c76f-f1a6-4ef9-bb43-17c334e316c9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:31.059455 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1800c76f-f1a6-4ef9-bb43-17c334e316c9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:31.059893 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1800c76f-f1a6-4ef9-bb43-17c334e316c9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:31.063815 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=100 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:31.192174 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-1800c76f-f1a6-4ef9-bb43-17c334e316c9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:50:31.199520 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-1800c76f-f1a6-4ef9-bb43-17c334e316c9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218" status: 200 len: 1555 microversion: 2.1 time: 0.153286 Jul 12 14:50:31.200082 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 571/1142] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:50:31 2022] GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:50:31.216080 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-949a4b18-adcb-49b9-ba5b-9e0f746791d9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:50:31.216706 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-949a4b18-adcb-49b9-ba5b-9e0f746791d9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:50:31.219573 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:31.225263 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-949a4b18-adcb-49b9-ba5b-9e0f746791d9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:31.225742 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-949a4b18-adcb-49b9-ba5b-9e0f746791d9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:31.226561 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-949a4b18-adcb-49b9-ba5b-9e0f746791d9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:31.226997 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-949a4b18-adcb-49b9-ba5b-9e0f746791d9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:31.305832 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-949a4b18-adcb-49b9-ba5b-9e0f746791d9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093663 Jul 12 14:50:31.306431 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 572/1143] 10.222.0.30 () {58 vars in 1274 bytes} [Tue Jul 12 14:50:31 2022] GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:50:32.583931 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-4d833651-4337-4653-ae07-a39903894efb req-b152b0c1-0693-4d1e-be57-4009ddc4bc87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae44ec45-2b42-4f9e-8df7-e6a7c4c70218", "tag": "2307d55e-97a3-4d99-963a-037ad1913986"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:50:32.593674 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-4d833651-4337-4653-ae07-a39903894efb req-b152b0c1-0693-4d1e-be57-4009ddc4bc87 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:50:32.594150 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-4d833651-4337-4653-ae07-a39903894efb req-b152b0c1-0693-4d1e-be57-4009ddc4bc87 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:50:32.607198 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-4d833651-4337-4653-ae07-a39903894efb req-b152b0c1-0693-4d1e-be57-4009ddc4bc87 service nova] Creating event network-changed:2307d55e-97a3-4d99-963a-037ad1913986 for instance ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 on hv-cinder-82002 Jul 12 14:50:32.612653 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-4d833651-4337-4653-ae07-a39903894efb req-b152b0c1-0693-4d1e-be57-4009ddc4bc87 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033789 Jul 12 14:50:32.613661 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 572/1144] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:51:05.031669 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-e6d1432d-40c8-402b-8822-c302b5ebd792 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:05.032282 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-e6d1432d-40c8-402b-8822-c302b5ebd792 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:05.039675 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e6d1432d-40c8-402b-8822-c302b5ebd792 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:05.040134 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e6d1432d-40c8-402b-8822-c302b5ebd792 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:05.040909 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e6d1432d-40c8-402b-8822-c302b5ebd792 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:05.041385 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e6d1432d-40c8-402b-8822-c302b5ebd792 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:05.064985 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-e6d1432d-40c8-402b-8822-c302b5ebd792 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218/ips" status: 200 len: 150 microversion: 2.1 time: 0.038096 Jul 12 14:51:05.065572 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 573/1145] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Jul 12 14:51:05 2022] GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:51:06.827671 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-ca63f36d-e1fa-44e5-9141-70843e5ff66d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cfbac715-66e7-4183-b18f-96ec72b6dd4a"}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:51:06.835781 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-ca63f36d-e1fa-44e5-9141-70843e5ff66d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:06.835781 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=7 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:51:06.837724 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ca63f36d-e1fa-44e5-9141-70843e5ff66d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:06.838336 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ca63f36d-e1fa-44e5-9141-70843e5ff66d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:06.839746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ca63f36d-e1fa-44e5-9141-70843e5ff66d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:06.840180 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-ca63f36d-e1fa-44e5-9141-70843e5ff66d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:08.255170 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-ca63f36d-e1fa-44e5-9141-70843e5ff66d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "POST /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.430978 Jul 12 14:51:08.255812 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 573/1146] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Jul 12 14:51:06 2022] POST /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218/os-volume_attachments => generated 194 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:51:14.054912 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-4ac9f9a5-a8ad-4e87-9d4e-a61ba5119e89 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:14.056105 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-4ac9f9a5-a8ad-4e87-9d4e-a61ba5119e89 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:14.062286 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4ac9f9a5-a8ad-4e87-9d4e-a61ba5119e89 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:14.062745 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4ac9f9a5-a8ad-4e87-9d4e-a61ba5119e89 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:14.063513 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4ac9f9a5-a8ad-4e87-9d4e-a61ba5119e89 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:14.063951 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-4ac9f9a5-a8ad-4e87-9d4e-a61ba5119e89 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:14.091633 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-4ac9f9a5-a8ad-4e87-9d4e-a61ba5119e89 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Going to try to terminate instance {{(pid=129980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:51:14.118799 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-f3ffa67c-4d74-4d87-ac18-afa59fd2f4cf req-4a673ee4-6163-480b-b722-cece1b79c92e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9", "tag": "cc4460df-a6f5-4837-9f82-68d3b6142fc5"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:51:14.127386 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-f3ffa67c-4d74-4d87-ac18-afa59fd2f4cf req-4a673ee4-6163-480b-b722-cece1b79c92e service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:14.128914 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-f3ffa67c-4d74-4d87-ac18-afa59fd2f4cf req-4a673ee4-6163-480b-b722-cece1b79c92e service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:14.139920 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-f3ffa67c-4d74-4d87-ac18-afa59fd2f4cf req-4a673ee4-6163-480b-b722-cece1b79c92e service nova] Creating event network-changed:cc4460df-a6f5-4837-9f82-68d3b6142fc5 for instance 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 on hv-cinder-82002 Jul 12 14:51:14.144909 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-f3ffa67c-4d74-4d87-ac18-afa59fd2f4cf req-4a673ee4-6163-480b-b722-cece1b79c92e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093062 Jul 12 14:51:14.145544 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 574/1147] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:51:14.469898 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-4ac9f9a5-a8ad-4e87-9d4e-a61ba5119e89 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 204 len: 0 microversion: 2.1 time: 0.418465 Jul 12 14:51:14.470895 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 574/1148] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Jul 12 14:51:14 2022] DELETE /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:51:14.479807 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-662cd52e-58d9-44c6-8eb0-f01ed1b28c9c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:14.480512 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-662cd52e-58d9-44c6-8eb0-f01ed1b28c9c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:14.487351 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-662cd52e-58d9-44c6-8eb0-f01ed1b28c9c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:14.487815 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-662cd52e-58d9-44c6-8eb0-f01ed1b28c9c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:14.488588 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-662cd52e-58d9-44c6-8eb0-f01ed1b28c9c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:14.489020 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-662cd52e-58d9-44c6-8eb0-f01ed1b28c9c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:14.673315 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-662cd52e-58d9-44c6-8eb0-f01ed1b28c9c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:51:14.680953 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-662cd52e-58d9-44c6-8eb0-f01ed1b28c9c tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 200 len: 1576 microversion: 2.1 time: 0.205394 Jul 12 14:51:14.681703 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 575/1149] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:14 2022] GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 1576 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:51:15.699232 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-68e76255-763e-49c1-a9c5-ea8ed4a7e6e5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:15.700487 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-68e76255-763e-49c1-a9c5-ea8ed4a7e6e5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:15.707470 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-68e76255-763e-49c1-a9c5-ea8ed4a7e6e5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:15.707986 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-68e76255-763e-49c1-a9c5-ea8ed4a7e6e5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:15.708827 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-68e76255-763e-49c1-a9c5-ea8ed4a7e6e5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:15.709297 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-68e76255-763e-49c1-a9c5-ea8ed4a7e6e5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:15.838553 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-68e76255-763e-49c1-a9c5-ea8ed4a7e6e5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:51:15.846023 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-68e76255-763e-49c1-a9c5-ea8ed4a7e6e5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 200 len: 1576 microversion: 2.1 time: 0.151035 Jul 12 14:51:15.846585 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 575/1150] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:15 2022] GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:51:16.863332 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-4109fd07-d9f5-402f-a4d6-36b30ba370ff tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:16.864004 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-4109fd07-d9f5-402f-a4d6-36b30ba370ff tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:16.870406 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4109fd07-d9f5-402f-a4d6-36b30ba370ff tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:16.870853 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4109fd07-d9f5-402f-a4d6-36b30ba370ff tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:16.871617 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4109fd07-d9f5-402f-a4d6-36b30ba370ff tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:16.872054 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4109fd07-d9f5-402f-a4d6-36b30ba370ff tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:17.094373 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-4109fd07-d9f5-402f-a4d6-36b30ba370ff tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:51:17.102273 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-4109fd07-d9f5-402f-a4d6-36b30ba370ff tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 200 len: 1458 microversion: 2.1 time: 0.243608 Jul 12 14:51:17.103085 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 576/1151] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:16 2022] GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 1458 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:51:17.357722 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-404a59b8-e635-40c5-b068-cf77cf6ab5f2 req-cf8cd9c6-e48c-4a5d-b5e2-49bbb0305205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9", "name": "network-vif-deleted", "tag": "cc4460df-a6f5-4837-9f82-68d3b6142fc5"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:51:17.366244 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-404a59b8-e635-40c5-b068-cf77cf6ab5f2 req-cf8cd9c6-e48c-4a5d-b5e2-49bbb0305205 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:17.369127 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-404a59b8-e635-40c5-b068-cf77cf6ab5f2 req-cf8cd9c6-e48c-4a5d-b5e2-49bbb0305205 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:17.378440 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-404a59b8-e635-40c5-b068-cf77cf6ab5f2 req-cf8cd9c6-e48c-4a5d-b5e2-49bbb0305205 service nova] Creating event network-vif-deleted:cc4460df-a6f5-4837-9f82-68d3b6142fc5 for instance 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 on hv-cinder-82002 Jul 12 14:51:17.384299 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-404a59b8-e635-40c5-b068-cf77cf6ab5f2 req-cf8cd9c6-e48c-4a5d-b5e2-49bbb0305205 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030364 Jul 12 14:51:17.384879 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 576/1152] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:51:17.852026 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-26c6544c-7f9b-4f93-a7d4-57eb1bca530d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cfbac715-66e7-4183-b18f-96ec72b6dd4a"}} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:51:17.853137 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-26c6544c-7f9b-4f93-a7d4-57eb1bca530d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:17.859833 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-26c6544c-7f9b-4f93-a7d4-57eb1bca530d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:17.860275 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-26c6544c-7f9b-4f93-a7d4-57eb1bca530d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:17.861027 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-26c6544c-7f9b-4f93-a7d4-57eb1bca530d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:17.861576 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-26c6544c-7f9b-4f93-a7d4-57eb1bca530d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:17.942000 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.wsgi [None req-26c6544c-7f9b-4f93-a7d4-57eb1bca530d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] HTTP exception thrown: Invalid volume: volume cfbac715-66e7-4183-b18f-96ec72b6dd4a is already attached to instances: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 Jul 12 14:51:17.943759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-26c6544c-7f9b-4f93-a7d4-57eb1bca530d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Request method failure captured: Jul 12 14:51:17.943759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: POST /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218/os-volume_attachments HTTP/1.1 Jul 12 14:51:17.943759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:51:17.943759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:51:17.943759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:51:17.943759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 74 Jul 12 14:51:17.943759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:51:17.943759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:51:17.943759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:51:17.943759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:51:17.943759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYl36fzTwFtVGKGnuLeWSR2xyzHWwW-MuDxWxaXdj_iqJqN47gaidjWXHzGJk8xWf-7iIhGkO1yM8AnekzxjKftE8wUnGgFJsehPH1UO-4j29uRFi6cowSALtK5HCNwfqNyHXXw02fXyxBOCZ4tFJOEbNcuLcZWDT9MpBcZT-ODszdo Jul 12 14:51:17.943759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:51:17.943759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:51:17.943759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:51:17.943759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:51:17.943759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:51:17.943759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:51:17.943759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: 35438fec2e37438e99201870e0d650af Jul 12 14:51:17.943759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:51:17.943759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:51:17.943759 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:51:17.950017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35438fec2e37438e99201870e0d650af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/35438fec2e37438e99201870e0d650af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35438fec2e37438e99201870e0d650af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_35438fec2e37438e99201870e0d650af", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:51:17.950017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:51:17.950017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: 35438fec2e37438e99201870e0d650af Jul 12 14:51:17.950017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:51:17.950017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-AttachVolumeNegativeTest-1692963561-project Jul 12 14:51:17.950017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:51:17.950017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:51:17.950017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: f926d674e2dc4eb58d7fe6379b79310b Jul 12 14:51:17.950017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-AttachVolumeNegativeTest-1692963561-project Jul 12 14:51:17.950017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Jul 12 14:51:17.950017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {"volumeAttachment": {"volumeId": "cfbac715-66e7-4183-b18f-96ec72b6dd4a"}} Jul 12 14:51:17.950017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: > Jul 12 14:51:17.950905 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Invalid volume: volume cfbac715-66e7-4183-b18f-96ec72b6dd4a is already attached to instances: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 Jul 12 14:51:17.950905 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'server_id': 'ae44ec45-2b42-4f9e-8df7-e6a7c4c70218', 'body': {'volumeAttachment': {'volumeId': 'cfbac715-66e7-4183-b18f-96ec72b6dd4a'}}} Jul 12 14:51:17.950905 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:51:17.950905 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:51:17.950905 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 14:51:17.950905 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 14:51:17.950905 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 14:51:17.950905 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 14:51:17.950905 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 12 14:51:17.950905 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 14:51:17.950905 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 12 14:51:17.950905 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 12 14:51:17.950905 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 12 14:51:17.950905 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 12 14:51:17.950905 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cfbac715-66e7-4183-b18f-96ec72b6dd4a is already attached to instances: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 Jul 12 14:51:17.950905 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:51:17.950905 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:51:17.950905 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:51:17.950905 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:51:17.952210 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:51:17.952210 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:51:17.952210 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:51:17.952210 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:51:17.952210 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:51:17.952210 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:51:17.952210 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 14:51:17.952210 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 14:51:17.952210 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 14:51:17.952210 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 14:51:17.952210 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 14:51:17.952210 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 14:51:17.952210 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 12 14:51:17.952210 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 12 14:51:17.952210 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cfbac715-66e7-4183-b18f-96ec72b6dd4a is already attached to instances: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 Jul 12 14:51:17.952210 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:51:17.952210 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:51:17.952210 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:51:17.952210 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:51:17.952210 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:51:17.953804 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:51:17.953804 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:51:17.953804 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:51:17.953804 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cfbac715-66e7-4183-b18f-96ec72b6dd4a is already attached to instances: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 Jul 12 14:51:17.953804 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:51:17.953804 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-26c6544c-7f9b-4f93-a7d4-57eb1bca530d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Returning 400 to user: Invalid volume: volume cfbac715-66e7-4183-b18f-96ec72b6dd4a is already attached to instances: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:51:17.953804 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-26c6544c-7f9b-4f93-a7d4-57eb1bca530d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "POST /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097917 Jul 12 14:51:17.953804 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 577/1153] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Jul 12 14:51:17 2022] POST /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 14:51:18.007732 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-7aa6de32-170b-41fc-a29c-4d10e1d71a7a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:18.008321 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-7aa6de32-170b-41fc-a29c-4d10e1d71a7a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:18.014555 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7aa6de32-170b-41fc-a29c-4d10e1d71a7a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:18.015003 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7aa6de32-170b-41fc-a29c-4d10e1d71a7a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:18.015767 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7aa6de32-170b-41fc-a29c-4d10e1d71a7a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:18.016209 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7aa6de32-170b-41fc-a29c-4d10e1d71a7a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:18.095151 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.objects.instance [None req-7aa6de32-170b-41fc-a29c-4d10e1d71a7a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lazy-loading 'services' on Instance uuid ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 {{(pid=129980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:51:18.121650 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-66e5bafd-1918-4296-a393-5b7997fe036e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:18.123014 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-66e5bafd-1918-4296-a393-5b7997fe036e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:18.130316 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-66e5bafd-1918-4296-a393-5b7997fe036e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:18.130813 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-66e5bafd-1918-4296-a393-5b7997fe036e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:18.131602 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-66e5bafd-1918-4296-a393-5b7997fe036e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:18.132100 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-66e5bafd-1918-4296-a393-5b7997fe036e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:18.165710 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-66e5bafd-1918-4296-a393-5b7997fe036e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:18.166276 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-66e5bafd-1918-4296-a393-5b7997fe036e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:18.166734 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.objects.instance [None req-66e5bafd-1918-4296-a393-5b7997fe036e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lazy-loading 'fault' on Instance uuid 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 {{(pid=129981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:51:18.208933 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-66e5bafd-1918-4296-a393-5b7997fe036e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:51:18.217317 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-66e5bafd-1918-4296-a393-5b7997fe036e tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 200 len: 1230 microversion: 2.1 time: 0.100381 Jul 12 14:51:18.219948 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 578/1154] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:18 2022] GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:51:18.432322 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-7aa6de32-170b-41fc-a29c-4d10e1d71a7a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218/os-volume_attachments/cfbac715-66e7-4183-b18f-96ec72b6dd4a" status: 202 len: 0 microversion: 2.1 time: 0.428944 Jul 12 14:51:18.432906 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 577/1155] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Jul 12 14:51:18 2022] DELETE /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218/os-volume_attachments/cfbac715-66e7-4183-b18f-96ec72b6dd4a => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:51:18.441129 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d1e0a840-f2f9-4dcc-a1c4-3dbd0529d8e9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:18.442072 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-d1e0a840-f2f9-4dcc-a1c4-3dbd0529d8e9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:18.448146 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d1e0a840-f2f9-4dcc-a1c4-3dbd0529d8e9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:18.448587 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d1e0a840-f2f9-4dcc-a1c4-3dbd0529d8e9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:18.449372 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d1e0a840-f2f9-4dcc-a1c4-3dbd0529d8e9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:18.449805 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d1e0a840-f2f9-4dcc-a1c4-3dbd0529d8e9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:18.479160 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-d1e0a840-f2f9-4dcc-a1c4-3dbd0529d8e9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041975 Jul 12 14:51:18.479706 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 579/1156] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Jul 12 14:51:18 2022] GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:51:19.235773 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-00f786d1-50c7-4a47-ab0e-ac753480b1fc tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:19.236498 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-00f786d1-50c7-4a47-ab0e-ac753480b1fc tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:19.242676 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-00f786d1-50c7-4a47-ab0e-ac753480b1fc tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:19.243122 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-00f786d1-50c7-4a47-ab0e-ac753480b1fc tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:19.243876 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-00f786d1-50c7-4a47-ab0e-ac753480b1fc tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:19.244313 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-00f786d1-50c7-4a47-ab0e-ac753480b1fc tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:19.258370 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.wsgi [None req-00f786d1-50c7-4a47-ab0e-ac753480b1fc tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] HTTP exception thrown: Instance 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 could not be found. Jul 12 14:51:19.259973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-00f786d1-50c7-4a47-ab0e-ac753480b1fc tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Request method failure captured: Jul 12 14:51:19.259973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: request: GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 HTTP/1.1 Jul 12 14:51:19.259973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept: application/json Jul 12 14:51:19.259973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept-Encoding: identity Jul 12 14:51:19.259973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Connection: close Jul 12 14:51:19.259973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Length: 0 Jul 12 14:51:19.259973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Type: application/json Jul 12 14:51:19.259973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Host: 10.222.0.30 Jul 12 14:51:19.259973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Openstack-System-Scope: None Jul 12 14:51:19.259973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: User-Agent: python-urllib3/1.26.9 Jul 12 14:51:19.259973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Auth-Token: gAAAAABizYiGjCIym6z7ILJLfgL5E7gSAaaEOfOvjScRoYkA2P5sV3l8LkGEy4FK246dlmLiBGEvuQLFzzVtPzEU-tjVx2ALpJ5bYbXLk3W_B29wKNoYAB1IBrjJdWJs_NfQV0TzQfZtzAzhqBpKyvD2ZxojTAbUH-xPxNyB_WulntIblw69vIU Jul 12 14:51:19.259973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Id: None Jul 12 14:51:19.259973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Name: None Jul 12 14:51:19.259973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Identity-Status: Confirmed Jul 12 14:51:19.259973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Is-Admin-Project: True Jul 12 14:51:19.259973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Id: default Jul 12 14:51:19.259973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Name: Default Jul 12 14:51:19.259973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Id: c361a671e3fc43c8a536f6526dc530b1 Jul 12 14:51:19.259973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Name: tempest-TestVolumeBootPattern-616836979 Jul 12 14:51:19.259973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Role: member,reader Jul 12 14:51:19.259973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Roles: member,reader Jul 12 14:51:19.261693 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c361a671e3fc43c8a536f6526dc530b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c361a671e3fc43c8a536f6526dc530b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c361a671e3fc43c8a536f6526dc530b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c361a671e3fc43c8a536f6526dc530b1", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:51:19.261693 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant: tempest-TestVolumeBootPattern-616836979 Jul 12 14:51:19.261693 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Id: c361a671e3fc43c8a536f6526dc530b1 Jul 12 14:51:19.261693 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Name: tempest-TestVolumeBootPattern-616836979 Jul 12 14:51:19.261693 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User: tempest-TestVolumeBootPattern-616836979-project Jul 12 14:51:19.261693 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Id: default Jul 12 14:51:19.261693 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Name: Default Jul 12 14:51:19.261693 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Id: 917bfc7c68384536a6945af83308f789 Jul 12 14:51:19.261693 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Name: tempest-TestVolumeBootPattern-616836979-project Jul 12 14:51:19.261693 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: method: > Jul 12 14:51:19.261693 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: exception: Instance 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 could not be found. Jul 12 14:51:19.261693 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: action_args: {'id': '7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9'} Jul 12 14:51:19.262649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:51:19.262649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:51:19.262649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:51:19.262649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:51:19.262649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:51:19.262649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:51:19.262649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:51:19.262649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:51:19.262649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:51:19.262649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:51:19.262649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 could not be found. Jul 12 14:51:19.262649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:51:19.262649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:51:19.262649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:51:19.262649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:51:19.262649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:51:19.262649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:51:19.262649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:51:19.262649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:51:19.262649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:51:19.264279 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:51:19.264279 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:51:19.264279 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:51:19.264279 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:51:19.264279 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:51:19.264279 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:51:19.264279 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:51:19.264279 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 could not be found. Jul 12 14:51:19.264279 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:51:19.264279 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:51:19.264279 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:51:19.264279 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:51:19.264279 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:51:19.264279 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:51:19.264279 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:51:19.264279 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:51:19.264279 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 could not be found. Jul 12 14:51:19.264279 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:51:19.265544 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-00f786d1-50c7-4a47-ab0e-ac753480b1fc tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Returning 404 to user: Instance 7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 could not be found. {{(pid=129980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:51:19.265544 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-00f786d1-50c7-4a47-ab0e-ac753480b1fc tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9" status: 404 len: 111 microversion: 2.1 time: 0.030357 Jul 12 14:51:19.265544 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 578/1157] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:19 2022] GET /compute/v2.1/servers/7c0e0573-3fbf-40cd-afc2-d6b6fbb3c9c9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:51:19.491232 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-2ef7fd68-9ced-46a7-a864-36d5846d3cde tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:19.493036 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-2ef7fd68-9ced-46a7-a864-36d5846d3cde tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:19.508436 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2ef7fd68-9ced-46a7-a864-36d5846d3cde tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:19.508880 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2ef7fd68-9ced-46a7-a864-36d5846d3cde tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:19.509673 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2ef7fd68-9ced-46a7-a864-36d5846d3cde tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:19.510101 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-2ef7fd68-9ced-46a7-a864-36d5846d3cde tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:19.539708 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-2ef7fd68-9ced-46a7-a864-36d5846d3cde tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052542 Jul 12 14:51:19.540257 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 580/1158] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Jul 12 14:51:19 2022] GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:51:20.551189 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ba53b651-4994-4ceb-9584-f86e07e4e4b0 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:20.552142 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-ba53b651-4994-4ceb-9584-f86e07e4e4b0 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:20.558578 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ba53b651-4994-4ceb-9584-f86e07e4e4b0 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:20.559054 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ba53b651-4994-4ceb-9584-f86e07e4e4b0 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:20.559830 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ba53b651-4994-4ceb-9584-f86e07e4e4b0 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:20.560837 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ba53b651-4994-4ceb-9584-f86e07e4e4b0 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:20.589215 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ba53b651-4994-4ceb-9584-f86e07e4e4b0 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042081 Jul 12 14:51:20.589771 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 579/1159] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Jul 12 14:51:20 2022] GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 14:51:20.646176 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-23832a1b-4e69-434d-a62d-7cc4b9f4cd5b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:20.646752 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-23832a1b-4e69-434d-a62d-7cc4b9f4cd5b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:20.653514 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-23832a1b-4e69-434d-a62d-7cc4b9f4cd5b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:20.654036 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-23832a1b-4e69-434d-a62d-7cc4b9f4cd5b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:20.654826 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-23832a1b-4e69-434d-a62d-7cc4b9f4cd5b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:20.655265 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-23832a1b-4e69-434d-a62d-7cc4b9f4cd5b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:20.681186 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-23832a1b-4e69-434d-a62d-7cc4b9f4cd5b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Going to try to terminate instance {{(pid=129981) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:51:21.001508 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-23832a1b-4e69-434d-a62d-7cc4b9f4cd5b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218" status: 204 len: 0 microversion: 2.1 time: 0.358764 Jul 12 14:51:21.002026 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 581/1160] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Jul 12 14:51:20 2022] DELETE /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:51:21.010532 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-5ecdaa7c-1a7c-4aaa-a71e-e18b95ae4bfd tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:21.011151 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-5ecdaa7c-1a7c-4aaa-a71e-e18b95ae4bfd tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:21.017141 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5ecdaa7c-1a7c-4aaa-a71e-e18b95ae4bfd tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:21.017638 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5ecdaa7c-1a7c-4aaa-a71e-e18b95ae4bfd tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:21.018406 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5ecdaa7c-1a7c-4aaa-a71e-e18b95ae4bfd tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:21.018844 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5ecdaa7c-1a7c-4aaa-a71e-e18b95ae4bfd tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:21.156208 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-5ecdaa7c-1a7c-4aaa-a71e-e18b95ae4bfd tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:51:21.164010 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-5ecdaa7c-1a7c-4aaa-a71e-e18b95ae4bfd tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218" status: 200 len: 1680 microversion: 2.1 time: 0.157302 Jul 12 14:51:21.164586 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 580/1161] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:21 2022] GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:51:22.182053 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e2ac83ab-bffb-426f-a9c2-3f991743de72 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:22.182672 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-e2ac83ab-bffb-426f-a9c2-3f991743de72 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:22.189148 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e2ac83ab-bffb-426f-a9c2-3f991743de72 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:22.189627 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e2ac83ab-bffb-426f-a9c2-3f991743de72 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:22.190390 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e2ac83ab-bffb-426f-a9c2-3f991743de72 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:22.190827 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e2ac83ab-bffb-426f-a9c2-3f991743de72 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:22.476344 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e2ac83ab-bffb-426f-a9c2-3f991743de72 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:51:22.485120 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-e2ac83ab-bffb-426f-a9c2-3f991743de72 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218" status: 200 len: 1680 microversion: 2.1 time: 0.307353 Jul 12 14:51:22.485836 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 582/1162] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:22 2022] GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 => generated 1680 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:51:22.804489 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-2a9ceb08-545b-47a2-bc97-ef48af128449 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:22.805613 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-2a9ceb08-545b-47a2-bc97-ef48af128449 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:22.812576 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-cfb5d260-d917-4066-99c5-2cb729e1db00 req-1d59cecb-26da-48ca-b81b-e6f4f1950b5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48873689-94c9-4887-9b4b-7eca17ddd173", "tag": "561b44eb-0d73-4072-bb0f-14b66c4fd904"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:51:22.821265 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2a9ceb08-545b-47a2-bc97-ef48af128449 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:22.821722 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2a9ceb08-545b-47a2-bc97-ef48af128449 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:22.822531 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2a9ceb08-545b-47a2-bc97-ef48af128449 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:22.822966 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2a9ceb08-545b-47a2-bc97-ef48af128449 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:22.838098 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-cfb5d260-d917-4066-99c5-2cb729e1db00 req-1d59cecb-26da-48ca-b81b-e6f4f1950b5f service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:22.838546 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-cfb5d260-d917-4066-99c5-2cb729e1db00 req-1d59cecb-26da-48ca-b81b-e6f4f1950b5f service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:22.856317 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-cfb5d260-d917-4066-99c5-2cb729e1db00 req-1d59cecb-26da-48ca-b81b-e6f4f1950b5f service nova] Creating event network-changed:561b44eb-0d73-4072-bb0f-14b66c4fd904 for instance 48873689-94c9-4887-9b4b-7eca17ddd173 on hv-cinder-82002 Jul 12 14:51:22.862054 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-cfb5d260-d917-4066-99c5-2cb729e1db00 req-1d59cecb-26da-48ca-b81b-e6f4f1950b5f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053756 Jul 12 14:51:22.863655 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 583/1163] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:51:22.872997 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-2a9ceb08-545b-47a2-bc97-ef48af128449 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Going to try to terminate instance {{(pid=129980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:51:23.258434 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-2a9ceb08-545b-47a2-bc97-ef48af128449 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "DELETE /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 204 len: 0 microversion: 2.1 time: 0.457982 Jul 12 14:51:23.262634 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 581/1164] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Jul 12 14:51:22 2022] DELETE /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:51:23.269679 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-64a8299f-6383-4750-94b7-62d7c7d235d7 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:23.271347 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-64a8299f-6383-4750-94b7-62d7c7d235d7 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:23.282587 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-64a8299f-6383-4750-94b7-62d7c7d235d7 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:23.284156 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-64a8299f-6383-4750-94b7-62d7c7d235d7 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:23.286507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-64a8299f-6383-4750-94b7-62d7c7d235d7 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:23.288531 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-64a8299f-6383-4750-94b7-62d7c7d235d7 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:23.503182 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-f252d152-3be8-4a4a-ad77-a4c4eb612878 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:23.504107 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-f252d152-3be8-4a4a-ad77-a4c4eb612878 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:23.513435 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-64a8299f-6383-4750-94b7-62d7c7d235d7 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:51:23.515484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f252d152-3be8-4a4a-ad77-a4c4eb612878 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:23.517993 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f252d152-3be8-4a4a-ad77-a4c4eb612878 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:23.518987 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f252d152-3be8-4a4a-ad77-a4c4eb612878 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:23.519438 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f252d152-3be8-4a4a-ad77-a4c4eb612878 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:23.530124 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-64a8299f-6383-4750-94b7-62d7c7d235d7 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 200 len: 1576 microversion: 2.1 time: 0.265756 Jul 12 14:51:23.533709 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 584/1165] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:23 2022] GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 1576 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:51:23.610065 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-f252d152-3be8-4a4a-ad77-a4c4eb612878 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:51:23.618376 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-f252d152-3be8-4a4a-ad77-a4c4eb612878 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218" status: 200 len: 1612 microversion: 2.1 time: 0.119705 Jul 12 14:51:23.618958 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 582/1166] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:23 2022] GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 => generated 1612 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:51:24.551967 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-8625b8c9-12aa-4a6b-a907-8b6f94902da1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:24.558008 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-8625b8c9-12aa-4a6b-a907-8b6f94902da1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:24.560993 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8625b8c9-12aa-4a6b-a907-8b6f94902da1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:24.561490 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8625b8c9-12aa-4a6b-a907-8b6f94902da1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:24.562552 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8625b8c9-12aa-4a6b-a907-8b6f94902da1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:24.562983 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-8625b8c9-12aa-4a6b-a907-8b6f94902da1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:24.640055 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-f037280c-b29b-44fd-935b-576236e89490 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:24.644104 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-f037280c-b29b-44fd-935b-576236e89490 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:24.651472 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f037280c-b29b-44fd-935b-576236e89490 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:24.651933 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f037280c-b29b-44fd-935b-576236e89490 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:24.652712 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f037280c-b29b-44fd-935b-576236e89490 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:24.653147 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f037280c-b29b-44fd-935b-576236e89490 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:24.745018 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-f037280c-b29b-44fd-935b-576236e89490 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:51:24.750449 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-8625b8c9-12aa-4a6b-a907-8b6f94902da1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:51:24.753470 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-f037280c-b29b-44fd-935b-576236e89490 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218" status: 200 len: 1612 microversion: 2.1 time: 0.121077 Jul 12 14:51:24.754050 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 583/1167] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:24 2022] GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 => generated 1612 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:51:24.764939 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-8625b8c9-12aa-4a6b-a907-8b6f94902da1 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 200 len: 1576 microversion: 2.1 time: 0.213895 Jul 12 14:51:24.764939 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 585/1168] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:24 2022] GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 1576 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:51:24.878190 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-1bc9ffaa-74c1-4ac6-a415-73a79a2977e1 req-df0d22c3-8484-4985-aafb-682c11c90850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae44ec45-2b42-4f9e-8df7-e6a7c4c70218", "name": "network-vif-deleted", "tag": "2307d55e-97a3-4d99-963a-037ad1913986"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:51:24.886557 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-1bc9ffaa-74c1-4ac6-a415-73a79a2977e1 req-df0d22c3-8484-4985-aafb-682c11c90850 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:24.886947 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-1bc9ffaa-74c1-4ac6-a415-73a79a2977e1 req-df0d22c3-8484-4985-aafb-682c11c90850 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:24.897467 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-1bc9ffaa-74c1-4ac6-a415-73a79a2977e1 req-df0d22c3-8484-4985-aafb-682c11c90850 service nova] Creating event network-vif-deleted:2307d55e-97a3-4d99-963a-037ad1913986 for instance ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 on hv-cinder-82002 Jul 12 14:51:24.904535 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-1bc9ffaa-74c1-4ac6-a415-73a79a2977e1 req-df0d22c3-8484-4985-aafb-682c11c90850 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027710 Jul 12 14:51:24.904535 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 584/1169] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:51:25.626920 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-681980b3-0853-451b-a113-9edde94b90f1 req-489e175d-10bb-4c3f-9282-d13a9164352a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48873689-94c9-4887-9b4b-7eca17ddd173", "name": "network-vif-deleted", "tag": "561b44eb-0d73-4072-bb0f-14b66c4fd904"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:51:25.635504 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-681980b3-0853-451b-a113-9edde94b90f1 req-489e175d-10bb-4c3f-9282-d13a9164352a service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:25.635952 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-681980b3-0853-451b-a113-9edde94b90f1 req-489e175d-10bb-4c3f-9282-d13a9164352a service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:25.647898 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-681980b3-0853-451b-a113-9edde94b90f1 req-489e175d-10bb-4c3f-9282-d13a9164352a service nova] Creating event network-vif-deleted:561b44eb-0d73-4072-bb0f-14b66c4fd904 for instance 48873689-94c9-4887-9b4b-7eca17ddd173 on hv-cinder-82002 Jul 12 14:51:25.652673 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-681980b3-0853-451b-a113-9edde94b90f1 req-489e175d-10bb-4c3f-9282-d13a9164352a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029368 Jul 12 14:51:25.653607 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 586/1170] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:51:25.773380 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-2ed53628-da78-41f7-951c-1c744c84a1f3 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:25.774000 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-2ed53628-da78-41f7-951c-1c744c84a1f3 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:25.779073 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-101cb4aa-5a26-4dee-9134-28512be3df2a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:25.779793 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-101cb4aa-5a26-4dee-9134-28512be3df2a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:25.780418 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2ed53628-da78-41f7-951c-1c744c84a1f3 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:25.780867 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2ed53628-da78-41f7-951c-1c744c84a1f3 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:25.781695 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2ed53628-da78-41f7-951c-1c744c84a1f3 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:25.782320 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2ed53628-da78-41f7-951c-1c744c84a1f3 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:25.785981 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-101cb4aa-5a26-4dee-9134-28512be3df2a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:25.786425 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-101cb4aa-5a26-4dee-9134-28512be3df2a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:25.791494 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-101cb4aa-5a26-4dee-9134-28512be3df2a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:25.791494 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-101cb4aa-5a26-4dee-9134-28512be3df2a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:25.817955 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2ed53628-da78-41f7-951c-1c744c84a1f3 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:25.818406 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-2ed53628-da78-41f7-951c-1c744c84a1f3 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:25.818856 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.objects.instance [None req-2ed53628-da78-41f7-951c-1c744c84a1f3 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lazy-loading 'fault' on Instance uuid ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 {{(pid=129980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:51:25.863662 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-101cb4aa-5a26-4dee-9134-28512be3df2a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917bfc7c68384536a6945af83308f789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c361a671e3fc43c8a536f6526dc530b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:51:25.871484 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-101cb4aa-5a26-4dee-9134-28512be3df2a tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 200 len: 1223 microversion: 2.1 time: 0.096638 Jul 12 14:51:25.877630 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 587/1171] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:25 2022] GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:51:25.883200 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-2ed53628-da78-41f7-951c-1c744c84a1f3 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:51:25.890065 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-2ed53628-da78-41f7-951c-1c744c84a1f3 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218" status: 200 len: 1329 microversion: 2.1 time: 0.121761 Jul 12 14:51:25.890630 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 585/1172] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:25 2022] GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 => generated 1329 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:51:26.889936 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-4a44f7fc-4f8e-4f64-b324-1a929d64acfd tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:26.890549 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-4a44f7fc-4f8e-4f64-b324-1a929d64acfd tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 48873689-94c9-4887-9b4b-7eca17ddd173] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:26.897176 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4a44f7fc-4f8e-4f64-b324-1a929d64acfd tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:26.897764 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4a44f7fc-4f8e-4f64-b324-1a929d64acfd tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:26.898486 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4a44f7fc-4f8e-4f64-b324-1a929d64acfd tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:26.898927 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-4a44f7fc-4f8e-4f64-b324-1a929d64acfd tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:26.903436 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:51:26.907129 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-72d1a72f-299c-451e-bc36-494f218549ac tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:26.907702 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-72d1a72f-299c-451e-bc36-494f218549ac tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:26.913055 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.wsgi [None req-4a44f7fc-4f8e-4f64-b324-1a929d64acfd tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] HTTP exception thrown: Instance 48873689-94c9-4887-9b4b-7eca17ddd173 could not be found. Jul 12 14:51:26.914328 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-72d1a72f-299c-451e-bc36-494f218549ac tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:26.914746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-4a44f7fc-4f8e-4f64-b324-1a929d64acfd tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Request method failure captured: Jul 12 14:51:26.914746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 HTTP/1.1 Jul 12 14:51:26.914746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:51:26.914746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:51:26.914746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:51:26.914746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 0 Jul 12 14:51:26.914746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:51:26.914746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:51:26.914746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:51:26.914746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:51:26.914746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYiGjCIym6z7ILJLfgL5E7gSAaaEOfOvjScRoYkA2P5sV3l8LkGEy4FK246dlmLiBGEvuQLFzzVtPzEU-tjVx2ALpJ5bYbXLk3W_B29wKNoYAB1IBrjJdWJs_NfQV0TzQfZtzAzhqBpKyvD2ZxojTAbUH-xPxNyB_WulntIblw69vIU Jul 12 14:51:26.914746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:51:26.914746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:51:26.914746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:51:26.914746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:51:26.914746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:51:26.914746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:51:26.914746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: c361a671e3fc43c8a536f6526dc530b1 Jul 12 14:51:26.914746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-TestVolumeBootPattern-616836979 Jul 12 14:51:26.914746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:51:26.914746 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:51:26.916308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c361a671e3fc43c8a536f6526dc530b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c361a671e3fc43c8a536f6526dc530b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c361a671e3fc43c8a536f6526dc530b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c361a671e3fc43c8a536f6526dc530b1", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:51:26.916308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-TestVolumeBootPattern-616836979 Jul 12 14:51:26.916308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: c361a671e3fc43c8a536f6526dc530b1 Jul 12 14:51:26.916308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-TestVolumeBootPattern-616836979 Jul 12 14:51:26.916308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-TestVolumeBootPattern-616836979-project Jul 12 14:51:26.916308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:51:26.916308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:51:26.916308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: 917bfc7c68384536a6945af83308f789 Jul 12 14:51:26.916308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-TestVolumeBootPattern-616836979-project Jul 12 14:51:26.916308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: > Jul 12 14:51:26.916308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Instance 48873689-94c9-4887-9b4b-7eca17ddd173 could not be found. Jul 12 14:51:26.916308 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'id': '48873689-94c9-4887-9b4b-7eca17ddd173'} Jul 12 14:51:26.917184 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:51:26.917184 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:51:26.917184 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:51:26.917184 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:51:26.917184 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:51:26.917184 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:51:26.917184 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:51:26.917184 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:51:26.917184 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:51:26.917184 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:51:26.917184 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48873689-94c9-4887-9b4b-7eca17ddd173 could not be found. Jul 12 14:51:26.917184 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:51:26.917184 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:51:26.917184 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:51:26.917184 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:51:26.917184 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:51:26.917184 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:51:26.917184 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:51:26.917184 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:51:26.917184 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:51:26.919158 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:51:26.919158 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:51:26.919158 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:51:26.919158 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:51:26.919158 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:51:26.919158 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:51:26.919158 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:51:26.919158 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48873689-94c9-4887-9b4b-7eca17ddd173 could not be found. Jul 12 14:51:26.919158 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:51:26.919158 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:51:26.919158 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:51:26.919158 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:51:26.919158 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:51:26.919158 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:51:26.919158 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:51:26.919158 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:51:26.919158 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48873689-94c9-4887-9b4b-7eca17ddd173 could not be found. Jul 12 14:51:26.919158 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:51:26.921496 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-72d1a72f-299c-451e-bc36-494f218549ac tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:26.922327 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-4a44f7fc-4f8e-4f64-b324-1a929d64acfd tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Returning 404 to user: Instance 48873689-94c9-4887-9b4b-7eca17ddd173 could not be found. {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:51:26.922439 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-72d1a72f-299c-451e-bc36-494f218549ac tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:26.922439 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-72d1a72f-299c-451e-bc36-494f218549ac tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:26.922634 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-4a44f7fc-4f8e-4f64-b324-1a929d64acfd tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173" status: 404 len: 111 microversion: 2.1 time: 0.030814 Jul 12 14:51:26.922634 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 588/1173] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:26 2022] GET /compute/v2.1/servers/48873689-94c9-4887-9b4b-7eca17ddd173 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:51:26.930523 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.wsgi [None req-72d1a72f-299c-451e-bc36-494f218549ac tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] HTTP exception thrown: Instance ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 could not be found. Jul 12 14:51:26.932183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-72d1a72f-299c-451e-bc36-494f218549ac tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Request method failure captured: Jul 12 14:51:26.932183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: request: GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 HTTP/1.1 Jul 12 14:51:26.932183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept: application/json Jul 12 14:51:26.932183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept-Encoding: identity Jul 12 14:51:26.932183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Connection: close Jul 12 14:51:26.932183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Length: 0 Jul 12 14:51:26.932183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Type: application/json Jul 12 14:51:26.932183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Host: 10.222.0.30 Jul 12 14:51:26.932183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Openstack-System-Scope: None Jul 12 14:51:26.932183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: User-Agent: python-urllib3/1.26.9 Jul 12 14:51:26.932183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Auth-Token: gAAAAABizYl36fzTwFtVGKGnuLeWSR2xyzHWwW-MuDxWxaXdj_iqJqN47gaidjWXHzGJk8xWf-7iIhGkO1yM8AnekzxjKftE8wUnGgFJsehPH1UO-4j29uRFi6cowSALtK5HCNwfqNyHXXw02fXyxBOCZ4tFJOEbNcuLcZWDT9MpBcZT-ODszdo Jul 12 14:51:26.932183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Id: None Jul 12 14:51:26.932183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Name: None Jul 12 14:51:26.932183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Identity-Status: Confirmed Jul 12 14:51:26.932183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Is-Admin-Project: True Jul 12 14:51:26.932183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Id: default Jul 12 14:51:26.932183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Name: Default Jul 12 14:51:26.932183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Id: 35438fec2e37438e99201870e0d650af Jul 12 14:51:26.932183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Name: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:51:26.932183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Role: member,reader Jul 12 14:51:26.932183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Roles: member,reader Jul 12 14:51:26.934164 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35438fec2e37438e99201870e0d650af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/35438fec2e37438e99201870e0d650af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35438fec2e37438e99201870e0d650af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_35438fec2e37438e99201870e0d650af", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:51:26.934164 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:51:26.934164 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Id: 35438fec2e37438e99201870e0d650af Jul 12 14:51:26.934164 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:51:26.934164 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User: tempest-AttachVolumeNegativeTest-1692963561-project Jul 12 14:51:26.934164 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Id: default Jul 12 14:51:26.934164 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Name: Default Jul 12 14:51:26.934164 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Id: f926d674e2dc4eb58d7fe6379b79310b Jul 12 14:51:26.934164 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Name: tempest-AttachVolumeNegativeTest-1692963561-project Jul 12 14:51:26.934164 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: method: > Jul 12 14:51:26.934164 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: exception: Instance ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 could not be found. Jul 12 14:51:26.934164 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: action_args: {'id': 'ae44ec45-2b42-4f9e-8df7-e6a7c4c70218'} Jul 12 14:51:26.939190 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:51:26.939190 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:51:26.939190 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:51:26.939190 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:51:26.939190 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:51:26.939190 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:51:26.939190 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:51:26.939190 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:51:26.939190 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:51:26.939190 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:51:26.939190 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 could not be found. Jul 12 14:51:26.939190 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:51:26.939190 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:51:26.939190 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:51:26.939190 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:51:26.939190 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:51:26.939190 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:51:26.939190 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:51:26.939190 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:51:26.939190 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:51:26.940747 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:51:26.940747 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:51:26.940747 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:51:26.940747 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:51:26.940747 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:51:26.940747 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:51:26.940747 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:51:26.940747 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 could not be found. Jul 12 14:51:26.940747 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:51:26.940747 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:51:26.940747 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:51:26.940747 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:51:26.940747 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:51:26.940747 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:51:26.940747 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:51:26.940747 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:51:26.940747 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 could not be found. Jul 12 14:51:26.940747 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:51:26.942141 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-72d1a72f-299c-451e-bc36-494f218549ac tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Returning 404 to user: Instance ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 could not be found. {{(pid=129980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:51:26.942141 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-72d1a72f-299c-451e-bc36-494f218549ac tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218" status: 404 len: 111 microversion: 2.1 time: 0.030764 Jul 12 14:51:26.942141 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 586/1174] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:26 2022] GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 14:51:26.943138 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-039c79e5-192a-418b-80e4-e0f0c0834fab tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '.version_select at 0x7f962c828af0>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:27.033974 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-039c79e5-192a-418b-80e4-e0f0c0834fab tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-565611176" status: 202 len: 0 microversion: 2.1 time: 0.094442 Jul 12 14:51:27.034480 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 589/1175] 10.222.0.30 () {58 vars in 1217 bytes} [Tue Jul 12 14:51:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-565611176 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:51:27.780964 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-e8620d09-48cb-47fb-bad4-4d36ac1c0a1d tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:27.781571 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-e8620d09-48cb-47fb-bad4-4d36ac1c0a1d tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:27.787660 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e8620d09-48cb-47fb-bad4-4d36ac1c0a1d tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:27.788196 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e8620d09-48cb-47fb-bad4-4d36ac1c0a1d tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:27.789042 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e8620d09-48cb-47fb-bad4-4d36ac1c0a1d tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:27.789595 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-e8620d09-48cb-47fb-bad4-4d36ac1c0a1d tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:27.803606 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.wsgi [None req-e8620d09-48cb-47fb-bad4-4d36ac1c0a1d tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] HTTP exception thrown: Instance 01cf8542-b5a1-4e34-a424-41d130ff60b6 could not be found. Jul 12 14:51:27.805194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-e8620d09-48cb-47fb-bad4-4d36ac1c0a1d tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Request method failure captured: Jul 12 14:51:27.805194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: request: DELETE /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 HTTP/1.1 Jul 12 14:51:27.805194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept: application/json Jul 12 14:51:27.805194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept-Encoding: identity Jul 12 14:51:27.805194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Connection: close Jul 12 14:51:27.805194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Length: 0 Jul 12 14:51:27.805194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Type: application/json Jul 12 14:51:27.805194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Host: 10.222.0.30 Jul 12 14:51:27.805194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Openstack-System-Scope: None Jul 12 14:51:27.805194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: User-Agent: python-urllib3/1.26.9 Jul 12 14:51:27.805194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Auth-Token: gAAAAABizYiGjCIym6z7ILJLfgL5E7gSAaaEOfOvjScRoYkA2P5sV3l8LkGEy4FK246dlmLiBGEvuQLFzzVtPzEU-tjVx2ALpJ5bYbXLk3W_B29wKNoYAB1IBrjJdWJs_NfQV0TzQfZtzAzhqBpKyvD2ZxojTAbUH-xPxNyB_WulntIblw69vIU Jul 12 14:51:27.805194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Id: None Jul 12 14:51:27.805194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Name: None Jul 12 14:51:27.805194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Identity-Status: Confirmed Jul 12 14:51:27.805194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Is-Admin-Project: True Jul 12 14:51:27.805194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Id: default Jul 12 14:51:27.805194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Name: Default Jul 12 14:51:27.805194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Id: c361a671e3fc43c8a536f6526dc530b1 Jul 12 14:51:27.805194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Name: tempest-TestVolumeBootPattern-616836979 Jul 12 14:51:27.805194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Role: member,reader Jul 12 14:51:27.805194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Roles: member,reader Jul 12 14:51:27.806869 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c361a671e3fc43c8a536f6526dc530b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c361a671e3fc43c8a536f6526dc530b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c361a671e3fc43c8a536f6526dc530b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c361a671e3fc43c8a536f6526dc530b1", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:51:27.806869 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant: tempest-TestVolumeBootPattern-616836979 Jul 12 14:51:27.806869 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Id: c361a671e3fc43c8a536f6526dc530b1 Jul 12 14:51:27.806869 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Name: tempest-TestVolumeBootPattern-616836979 Jul 12 14:51:27.806869 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User: tempest-TestVolumeBootPattern-616836979-project Jul 12 14:51:27.806869 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Id: default Jul 12 14:51:27.806869 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Name: Default Jul 12 14:51:27.806869 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Id: 917bfc7c68384536a6945af83308f789 Jul 12 14:51:27.806869 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Name: tempest-TestVolumeBootPattern-616836979-project Jul 12 14:51:27.806869 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: method: > Jul 12 14:51:27.806869 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: exception: Instance 01cf8542-b5a1-4e34-a424-41d130ff60b6 could not be found. Jul 12 14:51:27.806869 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: action_args: {'id': '01cf8542-b5a1-4e34-a424-41d130ff60b6'} Jul 12 14:51:27.807793 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:51:27.807793 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:51:27.807793 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:51:27.807793 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:51:27.807793 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:51:27.807793 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:51:27.807793 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:51:27.807793 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:51:27.807793 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:51:27.807793 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:51:27.807793 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01cf8542-b5a1-4e34-a424-41d130ff60b6 could not be found. Jul 12 14:51:27.807793 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:51:27.807793 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:51:27.807793 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:51:27.807793 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:51:27.807793 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:51:27.807793 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:51:27.807793 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:51:27.807793 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:51:27.807793 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:51:27.809118 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:51:27.809118 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 14:51:27.809118 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 14:51:27.809118 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 14:51:27.809118 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 14:51:27.809118 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:51:27.809118 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:51:27.809118 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:51:27.809118 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:51:27.809118 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01cf8542-b5a1-4e34-a424-41d130ff60b6 could not be found. Jul 12 14:51:27.809118 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:51:27.809118 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:51:27.809118 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:51:27.809118 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:51:27.809118 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:51:27.809118 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:51:27.809118 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:51:27.809118 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:51:27.809118 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01cf8542-b5a1-4e34-a424-41d130ff60b6 could not be found. Jul 12 14:51:27.809118 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:51:27.810489 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-e8620d09-48cb-47fb-bad4-4d36ac1c0a1d tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Returning 404 to user: Instance 01cf8542-b5a1-4e34-a424-41d130ff60b6 could not be found. {{(pid=129980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:51:27.810489 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-e8620d09-48cb-47fb-bad4-4d36ac1c0a1d tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "DELETE /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 404 len: 111 microversion: 2.1 time: 0.030101 Jul 12 14:51:27.810489 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 587/1176] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Jul 12 14:51:27 2022] DELETE /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:51:27.815815 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e38f8bb3-cc7f-472f-9df5-f4f98a770356 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:27.816431 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-e38f8bb3-cc7f-472f-9df5-f4f98a770356 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] [instance: 01cf8542-b5a1-4e34-a424-41d130ff60b6] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:27.824095 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e38f8bb3-cc7f-472f-9df5-f4f98a770356 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:27.824551 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e38f8bb3-cc7f-472f-9df5-f4f98a770356 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:27.825354 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e38f8bb3-cc7f-472f-9df5-f4f98a770356 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:27.825792 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e38f8bb3-cc7f-472f-9df5-f4f98a770356 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:27.839042 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.wsgi [None req-e38f8bb3-cc7f-472f-9df5-f4f98a770356 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] HTTP exception thrown: Instance 01cf8542-b5a1-4e34-a424-41d130ff60b6 could not be found. Jul 12 14:51:27.840583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e38f8bb3-cc7f-472f-9df5-f4f98a770356 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Request method failure captured: Jul 12 14:51:27.840583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 HTTP/1.1 Jul 12 14:51:27.840583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:51:27.840583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:51:27.840583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:51:27.840583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 0 Jul 12 14:51:27.840583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:51:27.840583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:51:27.840583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:51:27.840583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:51:27.840583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYiGjCIym6z7ILJLfgL5E7gSAaaEOfOvjScRoYkA2P5sV3l8LkGEy4FK246dlmLiBGEvuQLFzzVtPzEU-tjVx2ALpJ5bYbXLk3W_B29wKNoYAB1IBrjJdWJs_NfQV0TzQfZtzAzhqBpKyvD2ZxojTAbUH-xPxNyB_WulntIblw69vIU Jul 12 14:51:27.840583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:51:27.840583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:51:27.840583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:51:27.840583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:51:27.840583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:51:27.840583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:51:27.840583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: c361a671e3fc43c8a536f6526dc530b1 Jul 12 14:51:27.840583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-TestVolumeBootPattern-616836979 Jul 12 14:51:27.840583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:51:27.840583 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:51:27.842570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c361a671e3fc43c8a536f6526dc530b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c361a671e3fc43c8a536f6526dc530b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c361a671e3fc43c8a536f6526dc530b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c361a671e3fc43c8a536f6526dc530b1", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:51:27.842570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-TestVolumeBootPattern-616836979 Jul 12 14:51:27.842570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: c361a671e3fc43c8a536f6526dc530b1 Jul 12 14:51:27.842570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-TestVolumeBootPattern-616836979 Jul 12 14:51:27.842570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-TestVolumeBootPattern-616836979-project Jul 12 14:51:27.842570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:51:27.842570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:51:27.842570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: 917bfc7c68384536a6945af83308f789 Jul 12 14:51:27.842570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-TestVolumeBootPattern-616836979-project Jul 12 14:51:27.842570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: > Jul 12 14:51:27.842570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Instance 01cf8542-b5a1-4e34-a424-41d130ff60b6 could not be found. Jul 12 14:51:27.842570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'id': '01cf8542-b5a1-4e34-a424-41d130ff60b6'} Jul 12 14:51:27.843396 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:51:27.843396 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:51:27.843396 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:51:27.843396 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:51:27.843396 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:51:27.843396 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:51:27.843396 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:51:27.843396 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:51:27.843396 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:51:27.843396 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:51:27.843396 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01cf8542-b5a1-4e34-a424-41d130ff60b6 could not be found. Jul 12 14:51:27.843396 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:51:27.843396 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:51:27.843396 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:51:27.843396 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:51:27.843396 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:51:27.843396 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:51:27.843396 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:51:27.843396 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:51:27.843396 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:51:27.844844 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:51:27.844844 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:51:27.844844 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:51:27.844844 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:51:27.844844 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:51:27.844844 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:51:27.844844 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:51:27.844844 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01cf8542-b5a1-4e34-a424-41d130ff60b6 could not be found. Jul 12 14:51:27.844844 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:51:27.844844 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:51:27.844844 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:51:27.844844 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:51:27.844844 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:51:27.844844 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:51:27.844844 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:51:27.844844 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:51:27.844844 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01cf8542-b5a1-4e34-a424-41d130ff60b6 could not be found. Jul 12 14:51:27.844844 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:51:27.846634 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e38f8bb3-cc7f-472f-9df5-f4f98a770356 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Returning 404 to user: Instance 01cf8542-b5a1-4e34-a424-41d130ff60b6 could not be found. {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:51:27.846634 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-e38f8bb3-cc7f-472f-9df5-f4f98a770356 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6" status: 404 len: 111 microversion: 2.1 time: 0.030882 Jul 12 14:51:27.846634 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 590/1177] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:27 2022] GET /compute/v2.1/servers/01cf8542-b5a1-4e34-a424-41d130ff60b6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:51:28.158420 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-98d43738-24c4-4dd8-b3aa-44a0b8a7d98a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Action: 'create', calling method: .version_select at 0x7f962ca6b3a0>, body: {"keypair": {"name": "tempest-keypair-1969684286", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8q5sZEEQd6aL6Nk231tJsqH4iUXvXyl0QrTrUd5ld3FZ6wZ6TSVmGgicwNdCsouIFuvG4qcGXKPZugZWAChJhgcNvIcurQaMvI+vcfMZCXHU2DrLbr+YBBAKhG7v08hw=="}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:51:28.176213 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-98d43738-24c4-4dd8-b3aa-44a0b8a7d98a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Getting quotas for project 35438fec2e37438e99201870e0d650af. Resources: {'key_pairs'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:51:28.180195 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-98d43738-24c4-4dd8-b3aa-44a0b8a7d98a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Getting quotas for user f926d674e2dc4eb58d7fe6379b79310b and project 35438fec2e37438e99201870e0d650af. Resources: {'key_pairs'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:51:28.267610 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-98d43738-24c4-4dd8-b3aa-44a0b8a7d98a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.113643 Jul 12 14:51:28.268208 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 588/1178] 10.222.0.30 () {60 vars in 1158 bytes} [Tue Jul 12 14:51:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:51:29.344196 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-0f260304-2817-45ac-9488-14d5789d0be5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] Calling method '.version_select at 0x7f962ca18040>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:29.433995 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-0f260304-2817-45ac-9488-14d5789d0be5 tempest-TestVolumeBootPattern-616836979 tempest-TestVolumeBootPattern-616836979-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-616226702" status: 202 len: 0 microversion: 2.1 time: 0.094172 Jul 12 14:51:29.434498 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 591/1179] 10.222.0.30 () {58 vars in 1259 bytes} [Tue Jul 12 14:51:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-616226702 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:51:31.074468 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-b9d5822b-fa26-47fc-b654-b06220a19ff7 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-114838377", "imageRef": "a66ccacb-7b1e-4f51-9eaf-069a356e0fdb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18dbd310-dea2-4429-9ee9-f4f77e3d7b99"}], "security_groups": [{"name": "tempest-securitygroup--589454950"}], "key_name": "tempest-keypair-1969684286", "user_data": "}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:51:31.214654 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.network.neutron [None req-b9d5822b-fa26-47fc-b654-b06220a19ff7 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] validate_networks() for [('18dbd310-dea2-4429-9ee9-f4f77e3d7b99', None, None, None, None, None)] {{(pid=129980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:51:32.234601 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-b9d5822b-fa26-47fc-b654-b06220a19ff7 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Flavor limits 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:51:32.235704 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-b9d5822b-fa26-47fc-b654-b06220a19ff7 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Image limits 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:51:32.236184 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-b9d5822b-fa26-47fc-b654-b06220a19ff7 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Flavor pref 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:51:32.236600 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-b9d5822b-fa26-47fc-b654-b06220a19ff7 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Image pref 0:0:0 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:51:32.237118 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.virt.hardware [None req-b9d5822b-fa26-47fc-b654-b06220a19ff7 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:51:32.245945 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b9d5822b-fa26-47fc-b654-b06220a19ff7 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:32.246394 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b9d5822b-fa26-47fc-b654-b06220a19ff7 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:32.248033 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b9d5822b-fa26-47fc-b654-b06220a19ff7 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:32.248480 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b9d5822b-fa26-47fc-b654-b06220a19ff7 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:32.258548 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:51:32.269909 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-b9d5822b-fa26-47fc-b654-b06220a19ff7 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Getting quotas for project 35438fec2e37438e99201870e0d650af. Resources: {'instances', 'cores', 'ram'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:51:32.273993 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.quota [None req-b9d5822b-fa26-47fc-b654-b06220a19ff7 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Getting quotas for user f926d674e2dc4eb58d7fe6379b79310b and project 35438fec2e37438e99201870e0d650af. Resources: {'instances', 'cores', 'ram'} {{(pid=129980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:51:32.286176 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-b9d5822b-fa26-47fc-b654-b06220a19ff7 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Going to run 1 instances... {{(pid=129980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:51:32.288454 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-b9d5822b-fa26-47fc-b654-b06220a19ff7 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a66ccacb-7b1e-4f51-9eaf-069a356e0fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:51:32.430372 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-b9d5822b-fa26-47fc-b654-b06220a19ff7 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.360123 Jul 12 14:51:32.431026 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 589/1180] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Jul 12 14:51:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 1362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:51:32.445203 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-9b0b8922-d178-431c-b2ff-a5229932a56d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:32.445821 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-9b0b8922-d178-431c-b2ff-a5229932a56d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:32.533364 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-9b0b8922-d178-431c-b2ff-a5229932a56d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:51:32.541237 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-9b0b8922-d178-431c-b2ff-a5229932a56d tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b" status: 200 len: 1241 microversion: 2.1 time: 0.103698 Jul 12 14:51:32.542777 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 592/1181] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:32 2022] GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:51:33.581043 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-d15938a4-061c-4e84-a4e0-71888f049895 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:33.581043 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-d15938a4-061c-4e84-a4e0-71888f049895 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:33.581043 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d15938a4-061c-4e84-a4e0-71888f049895 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:33.581043 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d15938a4-061c-4e84-a4e0-71888f049895 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:33.582101 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d15938a4-061c-4e84-a4e0-71888f049895 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:33.582101 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d15938a4-061c-4e84-a4e0-71888f049895 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:33.682188 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-d15938a4-061c-4e84-a4e0-71888f049895 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:51:33.699313 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-d15938a4-061c-4e84-a4e0-71888f049895 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b" status: 200 len: 1245 microversion: 2.1 time: 0.144354 Jul 12 14:51:33.700911 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 590/1182] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:33 2022] GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b => generated 1245 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:51:34.717691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-e5e9f982-c452-4afa-a951-0a892abb8dd5 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:34.718362 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-e5e9f982-c452-4afa-a951-0a892abb8dd5 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:34.727002 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e5e9f982-c452-4afa-a951-0a892abb8dd5 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:34.727451 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e5e9f982-c452-4afa-a951-0a892abb8dd5 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:34.728267 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e5e9f982-c452-4afa-a951-0a892abb8dd5 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:34.728777 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-e5e9f982-c452-4afa-a951-0a892abb8dd5 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:34.797052 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-e5e9f982-c452-4afa-a951-0a892abb8dd5 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:51:34.805042 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-e5e9f982-c452-4afa-a951-0a892abb8dd5 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b" status: 200 len: 1301 microversion: 2.1 time: 0.092247 Jul 12 14:51:34.805657 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 593/1183] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:34 2022] GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b => generated 1301 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:51:35.822877 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0b62983e-5c1c-4ed7-b27b-5c7b5aae5255 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:35.824184 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-0b62983e-5c1c-4ed7-b27b-5c7b5aae5255 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:35.832008 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0b62983e-5c1c-4ed7-b27b-5c7b5aae5255 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:35.832468 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0b62983e-5c1c-4ed7-b27b-5c7b5aae5255 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:35.833278 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0b62983e-5c1c-4ed7-b27b-5c7b5aae5255 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:35.833727 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0b62983e-5c1c-4ed7-b27b-5c7b5aae5255 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:35.912557 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-0b62983e-5c1c-4ed7-b27b-5c7b5aae5255 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:51:35.922347 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-0b62983e-5c1c-4ed7-b27b-5c7b5aae5255 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b" status: 200 len: 1299 microversion: 2.1 time: 0.103671 Jul 12 14:51:35.932234 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 591/1184] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:35 2022] GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b => generated 1299 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:51:36.939956 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-0d7f52cb-fa03-43ca-be1d-18d4bb1cc180 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:36.940915 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-0d7f52cb-fa03-43ca-be1d-18d4bb1cc180 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:36.944865 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:51:36.948721 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0d7f52cb-fa03-43ca-be1d-18d4bb1cc180 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:36.949927 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0d7f52cb-fa03-43ca-be1d-18d4bb1cc180 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:36.950105 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0d7f52cb-fa03-43ca-be1d-18d4bb1cc180 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:36.950965 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-0d7f52cb-fa03-43ca-be1d-18d4bb1cc180 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:37.094901 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-0d7f52cb-fa03-43ca-be1d-18d4bb1cc180 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:51:37.103294 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-0d7f52cb-fa03-43ca-be1d-18d4bb1cc180 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b" status: 200 len: 1366 microversion: 2.1 time: 0.167234 Jul 12 14:51:37.113258 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 594/1185] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:36 2022] GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:51:37.659022 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-db429208-33a5-4bbb-8afe-9cc63677f920 req-4e55ebb1-51a8-4924-b858-cfa30e6d6c30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "026a3d00-8ac5-47b6-8202-39048ad9626b", "tag": "124bed5e-0c4d-4900-b33a-7b746f2e55d5"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:51:37.670074 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-db429208-33a5-4bbb-8afe-9cc63677f920 req-4e55ebb1-51a8-4924-b858-cfa30e6d6c30 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:37.670763 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-db429208-33a5-4bbb-8afe-9cc63677f920 req-4e55ebb1-51a8-4924-b858-cfa30e6d6c30 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:37.684139 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-db429208-33a5-4bbb-8afe-9cc63677f920 req-4e55ebb1-51a8-4924-b858-cfa30e6d6c30 service nova] Creating event network-changed:124bed5e-0c4d-4900-b33a-7b746f2e55d5 for instance 026a3d00-8ac5-47b6-8202-39048ad9626b on hv-cinder-82002 Jul 12 14:51:37.690294 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-db429208-33a5-4bbb-8afe-9cc63677f920 req-4e55ebb1-51a8-4924-b858-cfa30e6d6c30 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035560 Jul 12 14:51:37.691509 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 592/1186] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:51:38.121449 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-d3724608-edcd-4034-9534-15edca252d60 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:38.122658 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-d3724608-edcd-4034-9534-15edca252d60 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:38.131556 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d3724608-edcd-4034-9534-15edca252d60 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:38.132688 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d3724608-edcd-4034-9534-15edca252d60 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:38.133602 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d3724608-edcd-4034-9534-15edca252d60 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:38.134046 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-d3724608-edcd-4034-9534-15edca252d60 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:38.352280 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-d3724608-edcd-4034-9534-15edca252d60 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:51:38.361530 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-d3724608-edcd-4034-9534-15edca252d60 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b" status: 200 len: 1366 microversion: 2.1 time: 0.244993 Jul 12 14:51:38.362193 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 595/1187] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:38 2022] GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:51:39.381249 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-a9b0de44-85b6-46f0-93a0-dbfc8866b7b9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:39.382320 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-a9b0de44-85b6-46f0-93a0-dbfc8866b7b9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:39.394238 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a9b0de44-85b6-46f0-93a0-dbfc8866b7b9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:39.394238 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a9b0de44-85b6-46f0-93a0-dbfc8866b7b9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:39.394238 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a9b0de44-85b6-46f0-93a0-dbfc8866b7b9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:39.394615 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a9b0de44-85b6-46f0-93a0-dbfc8866b7b9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:39.532023 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-a9b0de44-85b6-46f0-93a0-dbfc8866b7b9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:51:39.539645 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-a9b0de44-85b6-46f0-93a0-dbfc8866b7b9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b" status: 200 len: 1366 microversion: 2.1 time: 0.164638 Jul 12 14:51:39.540213 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 593/1188] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:39 2022] GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:51:40.555737 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c5258f1e-d186-4801-9fbf-e9ac5b5e0662 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:40.556350 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-c5258f1e-d186-4801-9fbf-e9ac5b5e0662 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:40.563389 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c5258f1e-d186-4801-9fbf-e9ac5b5e0662 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:40.563833 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c5258f1e-d186-4801-9fbf-e9ac5b5e0662 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:40.564589 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c5258f1e-d186-4801-9fbf-e9ac5b5e0662 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:40.565136 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c5258f1e-d186-4801-9fbf-e9ac5b5e0662 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:40.765324 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-c5258f1e-d186-4801-9fbf-e9ac5b5e0662 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:51:40.765324 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-c5258f1e-d186-4801-9fbf-e9ac5b5e0662 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b" status: 200 len: 1366 microversion: 2.1 time: 0.202937 Jul 12 14:51:40.765324 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 596/1189] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:40 2022] GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:51:41.780579 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-9edde7f4-a811-4e59-a940-99ac7d683e35 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:41.781235 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-9edde7f4-a811-4e59-a940-99ac7d683e35 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:41.787789 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9edde7f4-a811-4e59-a940-99ac7d683e35 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:41.788241 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9edde7f4-a811-4e59-a940-99ac7d683e35 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:41.789017 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9edde7f4-a811-4e59-a940-99ac7d683e35 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:41.789499 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9edde7f4-a811-4e59-a940-99ac7d683e35 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:41.919390 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-9edde7f4-a811-4e59-a940-99ac7d683e35 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:51:41.926741 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-9edde7f4-a811-4e59-a940-99ac7d683e35 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b" status: 200 len: 1366 microversion: 2.1 time: 0.150769 Jul 12 14:51:41.927339 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 594/1190] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:41 2022] GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:51:42.943875 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-b0065e9a-3401-4617-b1dc-2847c55efe19 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:42.944498 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-b0065e9a-3401-4617-b1dc-2847c55efe19 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:42.946837 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell0:SELECT=2 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:51:42.951745 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b0065e9a-3401-4617-b1dc-2847c55efe19 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:42.952202 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b0065e9a-3401-4617-b1dc-2847c55efe19 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:42.952985 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b0065e9a-3401-4617-b1dc-2847c55efe19 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:42.953458 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-b0065e9a-3401-4617-b1dc-2847c55efe19 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:43.089732 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-b0065e9a-3401-4617-b1dc-2847c55efe19 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:51:43.097825 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-b0065e9a-3401-4617-b1dc-2847c55efe19 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b" status: 200 len: 1366 microversion: 2.1 time: 0.157890 Jul 12 14:51:43.098394 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 597/1191] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:42 2022] GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:51:44.114554 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-04b9c2cd-8dc8-43c6-bb20-0cbd6b55cc58 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:44.115171 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-04b9c2cd-8dc8-43c6-bb20-0cbd6b55cc58 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:44.117124 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell0:SELECT=2 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:51:44.117810 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell0:SELECT=10 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:51:44.118978 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:51:44.124377 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-04b9c2cd-8dc8-43c6-bb20-0cbd6b55cc58 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:44.124841 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-04b9c2cd-8dc8-43c6-bb20-0cbd6b55cc58 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:44.129102 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-04b9c2cd-8dc8-43c6-bb20-0cbd6b55cc58 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:44.129102 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-04b9c2cd-8dc8-43c6-bb20-0cbd6b55cc58 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:44.258396 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-04b9c2cd-8dc8-43c6-bb20-0cbd6b55cc58 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:51:44.267127 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-04b9c2cd-8dc8-43c6-bb20-0cbd6b55cc58 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b" status: 200 len: 1366 microversion: 2.1 time: 0.156730 Jul 12 14:51:44.267700 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 595/1192] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:44 2022] GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:51:44.471488 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-b5968dd3-ce0d-48e8-aa0a-c6ab35da7146 req-2ee229ff-8e23-47ee-a02f-809123c5c154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "026a3d00-8ac5-47b6-8202-39048ad9626b", "name": "network-vif-plugged", "status": "completed", "tag": "124bed5e-0c4d-4900-b33a-7b746f2e55d5"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:51:44.479928 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-b5968dd3-ce0d-48e8-aa0a-c6ab35da7146 req-2ee229ff-8e23-47ee-a02f-809123c5c154 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:44.480367 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-b5968dd3-ce0d-48e8-aa0a-c6ab35da7146 req-2ee229ff-8e23-47ee-a02f-809123c5c154 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:44.491522 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-b5968dd3-ce0d-48e8-aa0a-c6ab35da7146 req-2ee229ff-8e23-47ee-a02f-809123c5c154 service nova] Creating event network-vif-plugged:124bed5e-0c4d-4900-b33a-7b746f2e55d5 for instance 026a3d00-8ac5-47b6-8202-39048ad9626b on hv-cinder-82002 Jul 12 14:51:44.496432 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-b5968dd3-ce0d-48e8-aa0a-c6ab35da7146 req-2ee229ff-8e23-47ee-a02f-809123c5c154 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028663 Jul 12 14:51:44.497624 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 598/1193] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:51:45.285318 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-7c85f93e-2890-42ad-9077-b1b6017753e3 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:45.285968 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-7c85f93e-2890-42ad-9077-b1b6017753e3 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:45.293951 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7c85f93e-2890-42ad-9077-b1b6017753e3 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:45.293951 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7c85f93e-2890-42ad-9077-b1b6017753e3 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:45.293951 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7c85f93e-2890-42ad-9077-b1b6017753e3 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:45.293951 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-7c85f93e-2890-42ad-9077-b1b6017753e3 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:45.424728 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-7c85f93e-2890-42ad-9077-b1b6017753e3 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:51:45.432505 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-7c85f93e-2890-42ad-9077-b1b6017753e3 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b" status: 200 len: 1366 microversion: 2.1 time: 0.151668 Jul 12 14:51:45.433081 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 596/1194] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:45 2022] GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:51:46.450182 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-37c3e053-6321-400b-8c81-4047448859a9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:46.450913 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-37c3e053-6321-400b-8c81-4047448859a9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:46.457228 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-37c3e053-6321-400b-8c81-4047448859a9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:46.457683 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-37c3e053-6321-400b-8c81-4047448859a9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:46.458452 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-37c3e053-6321-400b-8c81-4047448859a9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:46.458923 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-37c3e053-6321-400b-8c81-4047448859a9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:46.589413 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-37c3e053-6321-400b-8c81-4047448859a9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:51:46.597442 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-37c3e053-6321-400b-8c81-4047448859a9 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b" status: 200 len: 1557 microversion: 2.1 time: 0.151921 Jul 12 14:51:46.598046 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 599/1195] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:51:46 2022] GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:51:46.613990 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-8efca72c-4721-4472-82c6-5e54cd003772 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:51:46.614496 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-8efca72c-4721-4472-82c6-5e54cd003772 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:51:46.621539 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8efca72c-4721-4472-82c6-5e54cd003772 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:46.621985 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8efca72c-4721-4472-82c6-5e54cd003772 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:46.622746 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8efca72c-4721-4472-82c6-5e54cd003772 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:46.623175 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-8efca72c-4721-4472-82c6-5e54cd003772 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:46.699552 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-8efca72c-4721-4472-82c6-5e54cd003772 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089386 Jul 12 14:51:46.700137 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 597/1196] 10.222.0.30 () {58 vars in 1274 bytes} [Tue Jul 12 14:51:46 2022] GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:51:47.696861 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-4e05d411-c6f8-4314-ae25-ab8b27cafd63 req-9158a0f2-81fe-4219-a983-073bf51fecbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "026a3d00-8ac5-47b6-8202-39048ad9626b", "tag": "124bed5e-0c4d-4900-b33a-7b746f2e55d5"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:51:47.707166 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-4e05d411-c6f8-4314-ae25-ab8b27cafd63 req-9158a0f2-81fe-4219-a983-073bf51fecbe service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:51:47.707956 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-4e05d411-c6f8-4314-ae25-ab8b27cafd63 req-9158a0f2-81fe-4219-a983-073bf51fecbe service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:51:47.720656 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-4e05d411-c6f8-4314-ae25-ab8b27cafd63 req-9158a0f2-81fe-4219-a983-073bf51fecbe service nova] Creating event network-changed:124bed5e-0c4d-4900-b33a-7b746f2e55d5 for instance 026a3d00-8ac5-47b6-8202-39048ad9626b on hv-cinder-82002 Jul 12 14:51:47.726906 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-4e05d411-c6f8-4314-ae25-ab8b27cafd63 req-9158a0f2-81fe-4219-a983-073bf51fecbe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033745 Jul 12 14:51:47.728322 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 600/1197] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:52:15.639537 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_api:SELECT=5 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:15.640284 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=42 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:15.861403 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-b31b3876-0643-4de3-aace-240a8a100a74 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:52:15.862315 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-b31b3876-0643-4de3-aace-240a8a100a74 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:52:15.868713 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b31b3876-0643-4de3-aace-240a8a100a74 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:15.869165 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b31b3876-0643-4de3-aace-240a8a100a74 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:15.869939 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b31b3876-0643-4de3-aace-240a8a100a74 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:15.870373 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-b31b3876-0643-4de3-aace-240a8a100a74 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:15.961863 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-b31b3876-0643-4de3-aace-240a8a100a74 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "POST /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d/action" status: 200 len: 14 microversion: 2.1 time: 0.323619 Jul 12 14:52:15.962461 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 598/1198] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Jul 12 14:52:15 2022] POST /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d/action => generated 14 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 14:52:17.108713 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-10b68233-2205-4c12-9503-65ce2169a4ce tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:52:17.109387 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-10b68233-2205-4c12-9503-65ce2169a4ce tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:52:17.112200 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_api:SELECT=13 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:17.112906 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=42 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:17.113036 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [req-3340001d-bdac-4721-977a-e443d79e884d req-565ce343-3d69-4cbd-a0b9-f461b7145a99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "336f3e15-d106-4a54-b655-49328b81248d", "tag": "07cdb948-262b-44e3-a60e-ac8f1916b818"}]} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:52:17.118256 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-10b68233-2205-4c12-9503-65ce2169a4ce tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:17.118712 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-10b68233-2205-4c12-9503-65ce2169a4ce tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:17.119498 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-10b68233-2205-4c12-9503-65ce2169a4ce tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:17.119935 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-10b68233-2205-4c12-9503-65ce2169a4ce tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:17.121733 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-3340001d-bdac-4721-977a-e443d79e884d req-565ce343-3d69-4cbd-a0b9-f461b7145a99 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:17.122174 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [req-3340001d-bdac-4721-977a-e443d79e884d req-565ce343-3d69-4cbd-a0b9-f461b7145a99 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:17.135024 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.compute.server_external_events [req-3340001d-bdac-4721-977a-e443d79e884d req-565ce343-3d69-4cbd-a0b9-f461b7145a99 service nova] Creating event network-changed:07cdb948-262b-44e3-a60e-ac8f1916b818 for instance 336f3e15-d106-4a54-b655-49328b81248d on hv-cinder-82002 Jul 12 14:52:17.140865 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [req-3340001d-bdac-4721-977a-e443d79e884d req-565ce343-3d69-4cbd-a0b9-f461b7145a99 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031125 Jul 12 14:52:17.143834 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 599/1199] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:52:17.150272 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-10b68233-2205-4c12-9503-65ce2169a4ce tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Going to try to terminate instance {{(pid=129981) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:52:17.554648 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-10b68233-2205-4c12-9503-65ce2169a4ce tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "DELETE /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 204 len: 0 microversion: 2.1 time: 0.450316 Jul 12 14:52:17.564527 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 601/1200] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Jul 12 14:52:17 2022] DELETE /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:52:17.571198 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-9f6435f8-2877-4ecc-bb86-768e9feb54f5 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:52:17.571543 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-9f6435f8-2877-4ecc-bb86-768e9feb54f5 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:52:17.578354 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9f6435f8-2877-4ecc-bb86-768e9feb54f5 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:17.578805 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9f6435f8-2877-4ecc-bb86-768e9feb54f5 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:17.579580 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9f6435f8-2877-4ecc-bb86-768e9feb54f5 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:17.580014 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9f6435f8-2877-4ecc-bb86-768e9feb54f5 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:17.718761 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-9f6435f8-2877-4ecc-bb86-768e9feb54f5 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:52:17.727304 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-9f6435f8-2877-4ecc-bb86-768e9feb54f5 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1568 microversion: 2.1 time: 0.161131 Jul 12 14:52:17.727897 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 600/1201] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:52:17 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:52:18.746753 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-155f431c-cda2-43ee-a84d-508f3385d0ef tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:52:18.747479 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-155f431c-cda2-43ee-a84d-508f3385d0ef tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:52:18.754013 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-155f431c-cda2-43ee-a84d-508f3385d0ef tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:18.755209 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-155f431c-cda2-43ee-a84d-508f3385d0ef tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:18.755971 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-155f431c-cda2-43ee-a84d-508f3385d0ef tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:18.756402 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-155f431c-cda2-43ee-a84d-508f3385d0ef tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:18.898480 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-155f431c-cda2-43ee-a84d-508f3385d0ef tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:52:18.898480 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-155f431c-cda2-43ee-a84d-508f3385d0ef tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1568 microversion: 2.1 time: 0.153617 Jul 12 14:52:18.898480 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 602/1202] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:52:18 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:52:19.914108 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-d98146ec-2236-4416-92d0-277df4d51875 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:52:19.914732 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-d98146ec-2236-4416-92d0-277df4d51875 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:52:19.920933 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d98146ec-2236-4416-92d0-277df4d51875 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:19.921895 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d98146ec-2236-4416-92d0-277df4d51875 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:19.922291 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d98146ec-2236-4416-92d0-277df4d51875 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:19.922725 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-d98146ec-2236-4416-92d0-277df4d51875 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:20.060790 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-d98146ec-2236-4416-92d0-277df4d51875 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:52:20.074581 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-d98146ec-2236-4416-92d0-277df4d51875 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1450 microversion: 2.1 time: 0.164918 Jul 12 14:52:20.075159 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 601/1203] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:52:19 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:52:20.120962 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-77222939-049c-4118-947a-f8f05550c1fc req-03a4be6f-1e04-482c-bbb7-96304db95e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "336f3e15-d106-4a54-b655-49328b81248d", "name": "network-vif-deleted", "tag": "07cdb948-262b-44e3-a60e-ac8f1916b818"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:52:20.130460 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-77222939-049c-4118-947a-f8f05550c1fc req-03a4be6f-1e04-482c-bbb7-96304db95e88 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:20.130902 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-77222939-049c-4118-947a-f8f05550c1fc req-03a4be6f-1e04-482c-bbb7-96304db95e88 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:20.142319 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-77222939-049c-4118-947a-f8f05550c1fc req-03a4be6f-1e04-482c-bbb7-96304db95e88 service nova] Creating event network-vif-deleted:07cdb948-262b-44e3-a60e-ac8f1916b818 for instance 336f3e15-d106-4a54-b655-49328b81248d on hv-cinder-82002 Jul 12 14:52:20.148176 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-77222939-049c-4118-947a-f8f05550c1fc req-03a4be6f-1e04-482c-bbb7-96304db95e88 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032563 Jul 12 14:52:20.148978 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 603/1204] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:52:21.091819 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ce801cca-7a37-46dc-937e-4d72c6dd27ce tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:52:21.092387 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-ce801cca-7a37-46dc-937e-4d72c6dd27ce tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:52:21.099120 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ce801cca-7a37-46dc-937e-4d72c6dd27ce tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:21.104061 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ce801cca-7a37-46dc-937e-4d72c6dd27ce tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:21.104061 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ce801cca-7a37-46dc-937e-4d72c6dd27ce tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:21.104061 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ce801cca-7a37-46dc-937e-4d72c6dd27ce tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:21.134977 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ce801cca-7a37-46dc-937e-4d72c6dd27ce tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:21.135442 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-ce801cca-7a37-46dc-937e-4d72c6dd27ce tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:21.135868 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.objects.instance [None req-ce801cca-7a37-46dc-937e-4d72c6dd27ce tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lazy-loading 'fault' on Instance uuid 336f3e15-d106-4a54-b655-49328b81248d {{(pid=129980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:52:21.179821 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-ce801cca-7a37-46dc-937e-4d72c6dd27ce tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df735fc7405643f285f529ddfa611064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa20247a7af46d0b9660d4cd026f552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:52:21.187270 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ce801cca-7a37-46dc-937e-4d72c6dd27ce tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 200 len: 1224 microversion: 2.1 time: 0.099391 Jul 12 14:52:21.187836 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 602/1205] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:52:21 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:52:22.205128 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-1b33dcd0-4602-4105-bfbf-9748bb2739e0 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:52:22.205838 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-1b33dcd0-4602-4105-bfbf-9748bb2739e0 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] [instance: 336f3e15-d106-4a54-b655-49328b81248d] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:52:22.212065 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1b33dcd0-4602-4105-bfbf-9748bb2739e0 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:22.212507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1b33dcd0-4602-4105-bfbf-9748bb2739e0 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:22.213281 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1b33dcd0-4602-4105-bfbf-9748bb2739e0 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:22.213712 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-1b33dcd0-4602-4105-bfbf-9748bb2739e0 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:22.227194 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.wsgi [None req-1b33dcd0-4602-4105-bfbf-9748bb2739e0 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] HTTP exception thrown: Instance 336f3e15-d106-4a54-b655-49328b81248d could not be found. Jul 12 14:52:22.228793 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-1b33dcd0-4602-4105-bfbf-9748bb2739e0 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Request method failure captured: Jul 12 14:52:22.228793 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d HTTP/1.1 Jul 12 14:52:22.228793 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:52:22.228793 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:52:22.228793 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:52:22.228793 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 0 Jul 12 14:52:22.228793 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:52:22.228793 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:52:22.228793 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:52:22.228793 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:52:22.228793 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYjs_Q-weLDWAPnwqI4qJ6aCuJPKBvxkXKPRvId2bwvRWtEjJFRfBEddBIC0QQCX2n7T2zXoDoe6sJeZCRKfogsTiu20tCL6CHLC_r9FViesnuLJC3qnf9-ftQIlrVLzGyqYtjh353DILmbSlZVCn0EvE-cV1SuwFkFICXFaTYLLWjQ Jul 12 14:52:22.228793 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:52:22.228793 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:52:22.228793 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:52:22.228793 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:52:22.228793 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:52:22.228793 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:52:22.228793 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: 8fa20247a7af46d0b9660d4cd026f552 Jul 12 14:52:22.228793 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-TestShelveInstance-1062108716 Jul 12 14:52:22.228793 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:52:22.228793 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:52:22.230572 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8fa20247a7af46d0b9660d4cd026f552"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8fa20247a7af46d0b9660d4cd026f552"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8fa20247a7af46d0b9660d4cd026f552"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8fa20247a7af46d0b9660d4cd026f552", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:52:22.230572 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-TestShelveInstance-1062108716 Jul 12 14:52:22.230572 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: 8fa20247a7af46d0b9660d4cd026f552 Jul 12 14:52:22.230572 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-TestShelveInstance-1062108716 Jul 12 14:52:22.230572 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-TestShelveInstance-1062108716-project Jul 12 14:52:22.230572 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:52:22.230572 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:52:22.230572 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: df735fc7405643f285f529ddfa611064 Jul 12 14:52:22.230572 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-TestShelveInstance-1062108716-project Jul 12 14:52:22.230572 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: > Jul 12 14:52:22.230572 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Instance 336f3e15-d106-4a54-b655-49328b81248d could not be found. Jul 12 14:52:22.230572 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'id': '336f3e15-d106-4a54-b655-49328b81248d'} Jul 12 14:52:22.232313 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:52:22.232313 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:22.232313 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:52:22.232313 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:52:22.232313 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:52:22.232313 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:52:22.232313 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:52:22.232313 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:52:22.232313 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:52:22.232313 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:52:22.232313 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 336f3e15-d106-4a54-b655-49328b81248d could not be found. Jul 12 14:52:22.232313 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:22.232313 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:52:22.232313 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:22.232313 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:22.232313 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:52:22.232313 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:52:22.232313 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:52:22.232313 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:52:22.232313 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:52:22.233754 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:52:22.233754 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:52:22.233754 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:52:22.233754 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:52:22.233754 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:52:22.233754 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:52:22.233754 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:52:22.233754 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 336f3e15-d106-4a54-b655-49328b81248d could not be found. Jul 12 14:52:22.233754 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:22.233754 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:52:22.233754 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:22.233754 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:22.233754 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:52:22.233754 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:52:22.233754 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:52:22.233754 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:52:22.233754 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 336f3e15-d106-4a54-b655-49328b81248d could not be found. Jul 12 14:52:22.233754 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:22.235177 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-1b33dcd0-4602-4105-bfbf-9748bb2739e0 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Returning 404 to user: Instance 336f3e15-d106-4a54-b655-49328b81248d could not be found. {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:52:22.235177 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-1b33dcd0-4602-4105-bfbf-9748bb2739e0 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d" status: 404 len: 111 microversion: 2.1 time: 0.029880 Jul 12 14:52:22.235177 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 604/1206] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:52:22 2022] GET /compute/v2.1/servers/336f3e15-d106-4a54-b655-49328b81248d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:52:22.493553 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-ae0f19a4-8c0c-4a37-a064-7e722e2f69e3 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] Calling method '.version_select at 0x7f962cbbd550>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:52:22.592142 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-ae0f19a4-8c0c-4a37-a064-7e722e2f69e3 tempest-TestShelveInstance-1062108716 tempest-TestShelveInstance-1062108716-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-470070880" status: 202 len: 0 microversion: 2.1 time: 0.103016 Jul 12 14:52:22.592741 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 603/1207] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Jul 12 14:52:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-470070880 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:52:24.060701 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-86c479e6-512c-42bf-bc63-76fb4737166f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:52:24.061260 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-86c479e6-512c-42bf-bc63-76fb4737166f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:52:24.067457 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-86c479e6-512c-42bf-bc63-76fb4737166f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:24.067913 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-86c479e6-512c-42bf-bc63-76fb4737166f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:24.068692 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-86c479e6-512c-42bf-bc63-76fb4737166f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:24.069126 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-86c479e6-512c-42bf-bc63-76fb4737166f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:24.092825 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-86c479e6-512c-42bf-bc63-76fb4737166f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b/ips" status: 200 len: 151 microversion: 2.1 time: 0.153113 Jul 12 14:52:24.093413 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 605/1208] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Jul 12 14:52:23 2022] GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b/ips => generated 151 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:52:25.837203 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-5307e792-3829-49a9-84e5-943578813182 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e63e56a-5ba5-4a39-a37d-26d0692970ba"}} {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:52:25.838783 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-5307e792-3829-49a9-84e5-943578813182 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:52:25.864414 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5307e792-3829-49a9-84e5-943578813182 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:25.865301 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5307e792-3829-49a9-84e5-943578813182 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:25.866352 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5307e792-3829-49a9-84e5-943578813182 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:25.867461 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5307e792-3829-49a9-84e5-943578813182 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:26.827484 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-5307e792-3829-49a9-84e5-943578813182 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "POST /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.993921 Jul 12 14:52:26.828129 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 604/1209] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Jul 12 14:52:25 2022] POST /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b/os-volume_attachments => generated 194 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:52:34.412718 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-68b6cd7f-e838-4fdd-a76a-ebc3cc4af1de tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:52:34.413249 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-68b6cd7f-e838-4fdd-a76a-ebc3cc4af1de tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:52:34.418832 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:34.418832 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG dbcounter [-] [129981] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:34.420902 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-68b6cd7f-e838-4fdd-a76a-ebc3cc4af1de tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:34.421388 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-68b6cd7f-e838-4fdd-a76a-ebc3cc4af1de tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:34.422155 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-68b6cd7f-e838-4fdd-a76a-ebc3cc4af1de tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:34.422592 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-68b6cd7f-e838-4fdd-a76a-ebc3cc4af1de tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:34.502758 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.objects.instance [None req-68b6cd7f-e838-4fdd-a76a-ebc3cc4af1de tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lazy-loading 'services' on Instance uuid 026a3d00-8ac5-47b6-8202-39048ad9626b {{(pid=129981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:52:34.767325 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-68b6cd7f-e838-4fdd-a76a-ebc3cc4af1de tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "DELETE /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b/os-volume_attachments/5e63e56a-5ba5-4a39-a37d-26d0692970ba" status: 202 len: 0 microversion: 2.1 time: 0.358151 Jul 12 14:52:34.767833 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 606/1210] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Jul 12 14:52:34 2022] DELETE /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b/os-volume_attachments/5e63e56a-5ba5-4a39-a37d-26d0692970ba => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:52:34.778183 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-681eeb7d-c650-4da1-abf6-9f4cb5c18c19 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:52:34.779216 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-681eeb7d-c650-4da1-abf6-9f4cb5c18c19 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:52:34.786332 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-681eeb7d-c650-4da1-abf6-9f4cb5c18c19 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:34.786779 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-681eeb7d-c650-4da1-abf6-9f4cb5c18c19 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:34.787609 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-681eeb7d-c650-4da1-abf6-9f4cb5c18c19 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:34.788047 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-681eeb7d-c650-4da1-abf6-9f4cb5c18c19 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:34.818095 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-681eeb7d-c650-4da1-abf6-9f4cb5c18c19 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045022 Jul 12 14:52:34.818650 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 605/1211] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Jul 12 14:52:34 2022] GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:52:35.830586 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-6e21a883-6533-4c7b-bea6-83c7a419b754 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:52:35.831641 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-6e21a883-6533-4c7b-bea6-83c7a419b754 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:52:35.838698 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6e21a883-6533-4c7b-bea6-83c7a419b754 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:35.841145 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6e21a883-6533-4c7b-bea6-83c7a419b754 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:35.841145 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6e21a883-6533-4c7b-bea6-83c7a419b754 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:35.841145 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-6e21a883-6533-4c7b-bea6-83c7a419b754 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:35.869050 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-6e21a883-6533-4c7b-bea6-83c7a419b754 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043607 Jul 12 14:52:35.869573 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 607/1212] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Jul 12 14:52:35 2022] GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:52:36.881629 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-5eb1fc21-5afc-4cf4-961a-6fe14e4ce88b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:52:36.882458 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-5eb1fc21-5afc-4cf4-961a-6fe14e4ce88b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:52:36.888987 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5eb1fc21-5afc-4cf4-961a-6fe14e4ce88b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:36.889462 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5eb1fc21-5afc-4cf4-961a-6fe14e4ce88b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:36.890215 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5eb1fc21-5afc-4cf4-961a-6fe14e4ce88b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:36.890647 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-5eb1fc21-5afc-4cf4-961a-6fe14e4ce88b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:36.918254 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-5eb1fc21-5afc-4cf4-961a-6fe14e4ce88b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041620 Jul 12 14:52:36.918800 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 606/1213] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Jul 12 14:52:36 2022] GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 14:52:36.974252 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-a958dbfc-4bf3-4820-984e-6b050c83c81b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:52:36.974732 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-a958dbfc-4bf3-4820-984e-6b050c83c81b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:52:36.981205 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a958dbfc-4bf3-4820-984e-6b050c83c81b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:36.981682 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a958dbfc-4bf3-4820-984e-6b050c83c81b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:36.982443 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a958dbfc-4bf3-4820-984e-6b050c83c81b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:36.982880 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-a958dbfc-4bf3-4820-984e-6b050c83c81b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:37.008797 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-a958dbfc-4bf3-4820-984e-6b050c83c81b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Going to try to terminate instance {{(pid=129981) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:52:37.383142 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-a958dbfc-4bf3-4820-984e-6b050c83c81b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "DELETE /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b" status: 204 len: 0 microversion: 2.1 time: 0.412372 Jul 12 14:52:37.383995 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 608/1214] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Jul 12 14:52:36 2022] DELETE /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:52:37.392264 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-a475d4db-8fbb-45f7-8bcf-b51d2f1a518f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:52:37.392887 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-a475d4db-8fbb-45f7-8bcf-b51d2f1a518f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:52:37.399056 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a475d4db-8fbb-45f7-8bcf-b51d2f1a518f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:37.399513 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a475d4db-8fbb-45f7-8bcf-b51d2f1a518f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:37.400279 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a475d4db-8fbb-45f7-8bcf-b51d2f1a518f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:37.400739 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-a475d4db-8fbb-45f7-8bcf-b51d2f1a518f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:37.534605 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-a475d4db-8fbb-45f7-8bcf-b51d2f1a518f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:52:37.543038 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-a475d4db-8fbb-45f7-8bcf-b51d2f1a518f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b" status: 200 len: 1682 microversion: 2.1 time: 0.154644 Jul 12 14:52:37.543613 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 607/1215] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:52:37 2022] GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:52:38.560615 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-12379774-56da-4673-ac14-622a8cfcd63f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:52:38.561367 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-12379774-56da-4673-ac14-622a8cfcd63f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:52:38.568357 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-12379774-56da-4673-ac14-622a8cfcd63f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:38.568803 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-12379774-56da-4673-ac14-622a8cfcd63f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:38.569591 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-12379774-56da-4673-ac14-622a8cfcd63f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:38.570030 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-12379774-56da-4673-ac14-622a8cfcd63f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:38.701667 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.policy [None req-12379774-56da-4673-ac14-622a8cfcd63f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:52:38.709108 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-12379774-56da-4673-ac14-622a8cfcd63f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b" status: 200 len: 1682 microversion: 2.1 time: 0.152739 Jul 12 14:52:38.712758 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 609/1216] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:52:38 2022] GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:52:39.726755 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-9f24f552-9c73-4889-8765-9347e994188b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:52:39.727365 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-9f24f552-9c73-4889-8765-9347e994188b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:52:39.734028 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9f24f552-9c73-4889-8765-9347e994188b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:39.734504 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9f24f552-9c73-4889-8765-9347e994188b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:39.735253 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9f24f552-9c73-4889-8765-9347e994188b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:39.735699 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-9f24f552-9c73-4889-8765-9347e994188b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:39.876163 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-9f24f552-9c73-4889-8765-9347e994188b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:52:39.884173 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-9f24f552-9c73-4889-8765-9347e994188b tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b" status: 200 len: 1682 microversion: 2.1 time: 0.161894 Jul 12 14:52:39.884973 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 608/1217] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:52:39 2022] GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:52:40.119252 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [req-630c8226-b2ab-429a-9fcc-d507ed74f185 req-ee707630-2271-4bf6-948e-38c12fb090b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "026a3d00-8ac5-47b6-8202-39048ad9626b", "name": "network-vif-deleted", "tag": "124bed5e-0c4d-4900-b33a-7b746f2e55d5"}]} {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:52:40.128332 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-630c8226-b2ab-429a-9fcc-d507ed74f185 req-ee707630-2271-4bf6-948e-38c12fb090b6 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:40.129043 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [req-630c8226-b2ab-429a-9fcc-d507ed74f185 req-ee707630-2271-4bf6-948e-38c12fb090b6 service nova] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:40.142998 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.compute.server_external_events [req-630c8226-b2ab-429a-9fcc-d507ed74f185 req-ee707630-2271-4bf6-948e-38c12fb090b6 service nova] Creating event network-vif-deleted:124bed5e-0c4d-4900-b33a-7b746f2e55d5 for instance 026a3d00-8ac5-47b6-8202-39048ad9626b on hv-cinder-82002 Jul 12 14:52:40.148658 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [req-630c8226-b2ab-429a-9fcc-d507ed74f185 req-ee707630-2271-4bf6-948e-38c12fb090b6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034612 Jul 12 14:52:40.149370 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 610/1218] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Jul 12 14:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:52:40.901685 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-f49c1494-8969-43c9-8b44-d31b9a926d51 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:52:40.902402 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-f49c1494-8969-43c9-8b44-d31b9a926d51 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:52:40.908972 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f49c1494-8969-43c9-8b44-d31b9a926d51 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:40.909471 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f49c1494-8969-43c9-8b44-d31b9a926d51 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:40.910773 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f49c1494-8969-43c9-8b44-d31b9a926d51 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:40.911216 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f49c1494-8969-43c9-8b44-d31b9a926d51 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:40.944942 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f49c1494-8969-43c9-8b44-d31b9a926d51 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:40.945428 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-f49c1494-8969-43c9-8b44-d31b9a926d51 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:40.945888 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.objects.instance [None req-f49c1494-8969-43c9-8b44-d31b9a926d51 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lazy-loading 'fault' on Instance uuid 026a3d00-8ac5-47b6-8202-39048ad9626b {{(pid=129980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:52:40.987718 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.policy [None req-f49c1494-8969-43c9-8b44-d31b9a926d51 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f926d674e2dc4eb58d7fe6379b79310b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35438fec2e37438e99201870e0d650af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:52:40.997349 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-f49c1494-8969-43c9-8b44-d31b9a926d51 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b" status: 200 len: 1331 microversion: 2.1 time: 0.099444 Jul 12 14:52:40.998124 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 609/1219] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:52:40 2022] GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:52:42.016044 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c0465eec-3d9c-46a2-bcd4-47fb23b0994f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:52:42.016656 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-c0465eec-3d9c-46a2-bcd4-47fb23b0994f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:52:42.023432 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c0465eec-3d9c-46a2-bcd4-47fb23b0994f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:42.023879 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c0465eec-3d9c-46a2-bcd4-47fb23b0994f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:42.024633 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c0465eec-3d9c-46a2-bcd4-47fb23b0994f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:42.025064 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c0465eec-3d9c-46a2-bcd4-47fb23b0994f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:42.038244 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.wsgi [None req-c0465eec-3d9c-46a2-bcd4-47fb23b0994f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] HTTP exception thrown: Instance 026a3d00-8ac5-47b6-8202-39048ad9626b could not be found. Jul 12 14:52:42.039843 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c0465eec-3d9c-46a2-bcd4-47fb23b0994f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Request method failure captured: Jul 12 14:52:42.039843 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b HTTP/1.1 Jul 12 14:52:42.039843 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:52:42.039843 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:52:42.039843 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:52:42.039843 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 0 Jul 12 14:52:42.039843 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:52:42.039843 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:52:42.039843 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:52:42.039843 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:52:42.039843 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYl36fzTwFtVGKGnuLeWSR2xyzHWwW-MuDxWxaXdj_iqJqN47gaidjWXHzGJk8xWf-7iIhGkO1yM8AnekzxjKftE8wUnGgFJsehPH1UO-4j29uRFi6cowSALtK5HCNwfqNyHXXw02fXyxBOCZ4tFJOEbNcuLcZWDT9MpBcZT-ODszdo Jul 12 14:52:42.039843 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:52:42.039843 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:52:42.039843 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:52:42.039843 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:52:42.039843 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:52:42.039843 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:52:42.039843 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: 35438fec2e37438e99201870e0d650af Jul 12 14:52:42.039843 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:52:42.039843 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:52:42.039843 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:52:42.041607 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35438fec2e37438e99201870e0d650af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/35438fec2e37438e99201870e0d650af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35438fec2e37438e99201870e0d650af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_35438fec2e37438e99201870e0d650af", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:52:42.041607 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:52:42.041607 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: 35438fec2e37438e99201870e0d650af Jul 12 14:52:42.041607 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:52:42.041607 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-AttachVolumeNegativeTest-1692963561-project Jul 12 14:52:42.041607 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:52:42.041607 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:52:42.041607 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: f926d674e2dc4eb58d7fe6379b79310b Jul 12 14:52:42.041607 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-AttachVolumeNegativeTest-1692963561-project Jul 12 14:52:42.041607 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: > Jul 12 14:52:42.041607 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Instance 026a3d00-8ac5-47b6-8202-39048ad9626b could not be found. Jul 12 14:52:42.041607 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'id': '026a3d00-8ac5-47b6-8202-39048ad9626b'} Jul 12 14:52:42.042606 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:52:42.042606 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:42.042606 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:52:42.042606 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:52:42.042606 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:52:42.042606 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:52:42.042606 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:52:42.042606 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:52:42.042606 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:52:42.042606 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:52:42.042606 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 026a3d00-8ac5-47b6-8202-39048ad9626b could not be found. Jul 12 14:52:42.042606 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:42.042606 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:52:42.042606 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:42.042606 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:42.042606 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:52:42.042606 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:52:42.042606 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:52:42.042606 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:52:42.042606 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:52:42.044239 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:52:42.044239 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:52:42.044239 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:52:42.044239 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:52:42.044239 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:52:42.044239 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:52:42.044239 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:52:42.044239 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 026a3d00-8ac5-47b6-8202-39048ad9626b could not be found. Jul 12 14:52:42.044239 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:42.044239 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:52:42.044239 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:42.044239 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:42.044239 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:52:42.044239 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:52:42.044239 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:52:42.044239 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:52:42.044239 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 026a3d00-8ac5-47b6-8202-39048ad9626b could not be found. Jul 12 14:52:42.044239 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:42.045844 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c0465eec-3d9c-46a2-bcd4-47fb23b0994f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Returning 404 to user: Instance 026a3d00-8ac5-47b6-8202-39048ad9626b could not be found. {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:52:42.045844 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-c0465eec-3d9c-46a2-bcd4-47fb23b0994f tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b" status: 404 len: 111 microversion: 2.1 time: 0.030248 Jul 12 14:52:42.045844 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 611/1220] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:52:42 2022] GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:52:42.050192 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-f4de3a85-e780-4231-9679-294ea21ada47 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '.version_select at 0x7f962cbbda60>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:52:42.129753 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-f4de3a85-e780-4231-9679-294ea21ada47 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1969684286" status: 202 len: 0 microversion: 2.1 time: 0.082331 Jul 12 14:52:42.130343 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 610/1221] 10.222.0.30 () {58 vars in 1220 bytes} [Tue Jul 12 14:52:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1969684286 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 14:52:44.197513 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c3f1ffcf-c97d-4eff-a66c-013070296cbf tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:52:44.198032 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-c3f1ffcf-c97d-4eff-a66c-013070296cbf tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:52:44.205417 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c3f1ffcf-c97d-4eff-a66c-013070296cbf tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:44.205895 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c3f1ffcf-c97d-4eff-a66c-013070296cbf tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:44.206734 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c3f1ffcf-c97d-4eff-a66c-013070296cbf tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:44.207168 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c3f1ffcf-c97d-4eff-a66c-013070296cbf tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:44.220516 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.wsgi [None req-c3f1ffcf-c97d-4eff-a66c-013070296cbf tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] HTTP exception thrown: Instance 026a3d00-8ac5-47b6-8202-39048ad9626b could not be found. Jul 12 14:52:44.222051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c3f1ffcf-c97d-4eff-a66c-013070296cbf tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Request method failure captured: Jul 12 14:52:44.222051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: DELETE /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b HTTP/1.1 Jul 12 14:52:44.222051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:52:44.222051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:52:44.222051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:52:44.222051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 0 Jul 12 14:52:44.222051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:52:44.222051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:52:44.222051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:52:44.222051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:52:44.222051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYl36fzTwFtVGKGnuLeWSR2xyzHWwW-MuDxWxaXdj_iqJqN47gaidjWXHzGJk8xWf-7iIhGkO1yM8AnekzxjKftE8wUnGgFJsehPH1UO-4j29uRFi6cowSALtK5HCNwfqNyHXXw02fXyxBOCZ4tFJOEbNcuLcZWDT9MpBcZT-ODszdo Jul 12 14:52:44.222051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:52:44.222051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:52:44.222051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:52:44.222051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:52:44.222051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:52:44.222051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:52:44.222051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: 35438fec2e37438e99201870e0d650af Jul 12 14:52:44.222051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:52:44.222051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:52:44.222051 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:52:44.223997 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35438fec2e37438e99201870e0d650af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/35438fec2e37438e99201870e0d650af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35438fec2e37438e99201870e0d650af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_35438fec2e37438e99201870e0d650af", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:52:44.223997 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:52:44.223997 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: 35438fec2e37438e99201870e0d650af Jul 12 14:52:44.223997 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:52:44.223997 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-AttachVolumeNegativeTest-1692963561-project Jul 12 14:52:44.223997 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:52:44.223997 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:52:44.223997 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: f926d674e2dc4eb58d7fe6379b79310b Jul 12 14:52:44.223997 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-AttachVolumeNegativeTest-1692963561-project Jul 12 14:52:44.223997 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: > Jul 12 14:52:44.223997 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Instance 026a3d00-8ac5-47b6-8202-39048ad9626b could not be found. Jul 12 14:52:44.223997 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'id': '026a3d00-8ac5-47b6-8202-39048ad9626b'} Jul 12 14:52:44.226508 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:52:44.226508 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:44.226508 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:52:44.226508 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:52:44.226508 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:52:44.226508 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:52:44.226508 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:52:44.226508 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:52:44.226508 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:52:44.226508 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:52:44.226508 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 026a3d00-8ac5-47b6-8202-39048ad9626b could not be found. Jul 12 14:52:44.226508 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:44.226508 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:52:44.226508 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:44.226508 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:44.226508 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:52:44.226508 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:52:44.226508 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:52:44.226508 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:52:44.226508 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:52:44.228195 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:52:44.228195 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 14:52:44.228195 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 14:52:44.228195 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 14:52:44.228195 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 14:52:44.228195 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:52:44.228195 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:52:44.228195 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:52:44.228195 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:52:44.228195 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 026a3d00-8ac5-47b6-8202-39048ad9626b could not be found. Jul 12 14:52:44.228195 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:44.228195 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:52:44.228195 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:44.228195 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:44.228195 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:52:44.228195 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:52:44.228195 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:52:44.228195 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:52:44.228195 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 026a3d00-8ac5-47b6-8202-39048ad9626b could not be found. Jul 12 14:52:44.228195 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:44.229852 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c3f1ffcf-c97d-4eff-a66c-013070296cbf tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Returning 404 to user: Instance 026a3d00-8ac5-47b6-8202-39048ad9626b could not be found. {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:52:44.229852 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-c3f1ffcf-c97d-4eff-a66c-013070296cbf tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "DELETE /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b" status: 404 len: 111 microversion: 2.1 time: 0.030294 Jul 12 14:52:44.229852 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 612/1222] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Jul 12 14:52:44 2022] DELETE /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:52:44.232761 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-00239657-1c7d-4ac3-aa92-b1a3e0448826 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:52:44.233426 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-00239657-1c7d-4ac3-aa92-b1a3e0448826 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 026a3d00-8ac5-47b6-8202-39048ad9626b] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:52:44.240633 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-00239657-1c7d-4ac3-aa92-b1a3e0448826 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:44.241076 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-00239657-1c7d-4ac3-aa92-b1a3e0448826 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:44.241874 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-00239657-1c7d-4ac3-aa92-b1a3e0448826 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:44.242311 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-00239657-1c7d-4ac3-aa92-b1a3e0448826 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:44.255383 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.wsgi [None req-00239657-1c7d-4ac3-aa92-b1a3e0448826 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] HTTP exception thrown: Instance 026a3d00-8ac5-47b6-8202-39048ad9626b could not be found. Jul 12 14:52:44.256994 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-00239657-1c7d-4ac3-aa92-b1a3e0448826 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Request method failure captured: Jul 12 14:52:44.256994 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: request: GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b HTTP/1.1 Jul 12 14:52:44.256994 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept: application/json Jul 12 14:52:44.256994 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept-Encoding: identity Jul 12 14:52:44.256994 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Connection: close Jul 12 14:52:44.256994 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Length: 0 Jul 12 14:52:44.256994 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Type: application/json Jul 12 14:52:44.256994 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Host: 10.222.0.30 Jul 12 14:52:44.256994 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Openstack-System-Scope: None Jul 12 14:52:44.256994 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: User-Agent: python-urllib3/1.26.9 Jul 12 14:52:44.256994 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Auth-Token: gAAAAABizYl36fzTwFtVGKGnuLeWSR2xyzHWwW-MuDxWxaXdj_iqJqN47gaidjWXHzGJk8xWf-7iIhGkO1yM8AnekzxjKftE8wUnGgFJsehPH1UO-4j29uRFi6cowSALtK5HCNwfqNyHXXw02fXyxBOCZ4tFJOEbNcuLcZWDT9MpBcZT-ODszdo Jul 12 14:52:44.256994 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Id: None Jul 12 14:52:44.256994 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Name: None Jul 12 14:52:44.256994 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Identity-Status: Confirmed Jul 12 14:52:44.256994 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Is-Admin-Project: True Jul 12 14:52:44.256994 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Id: default Jul 12 14:52:44.256994 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Name: Default Jul 12 14:52:44.256994 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Id: 35438fec2e37438e99201870e0d650af Jul 12 14:52:44.256994 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Name: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:52:44.256994 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Role: member,reader Jul 12 14:52:44.256994 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Roles: member,reader Jul 12 14:52:44.258715 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35438fec2e37438e99201870e0d650af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/35438fec2e37438e99201870e0d650af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35438fec2e37438e99201870e0d650af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_35438fec2e37438e99201870e0d650af", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:52:44.258715 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:52:44.258715 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Id: 35438fec2e37438e99201870e0d650af Jul 12 14:52:44.258715 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:52:44.258715 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User: tempest-AttachVolumeNegativeTest-1692963561-project Jul 12 14:52:44.258715 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Id: default Jul 12 14:52:44.258715 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Name: Default Jul 12 14:52:44.258715 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Id: f926d674e2dc4eb58d7fe6379b79310b Jul 12 14:52:44.258715 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Name: tempest-AttachVolumeNegativeTest-1692963561-project Jul 12 14:52:44.258715 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: method: > Jul 12 14:52:44.258715 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: exception: Instance 026a3d00-8ac5-47b6-8202-39048ad9626b could not be found. Jul 12 14:52:44.258715 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: action_args: {'id': '026a3d00-8ac5-47b6-8202-39048ad9626b'} Jul 12 14:52:44.259775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:52:44.259775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:44.259775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:52:44.259775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:52:44.259775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:52:44.259775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:52:44.259775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:52:44.259775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:52:44.259775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:52:44.259775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:52:44.259775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 026a3d00-8ac5-47b6-8202-39048ad9626b could not be found. Jul 12 14:52:44.259775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:52:44.259775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:52:44.259775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:52:44.259775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:44.259775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:52:44.259775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:52:44.259775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:52:44.259775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:52:44.259775 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:52:44.261369 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:52:44.261369 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:52:44.261369 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:52:44.261369 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:52:44.261369 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:52:44.261369 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:52:44.261369 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:52:44.261369 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 026a3d00-8ac5-47b6-8202-39048ad9626b could not be found. Jul 12 14:52:44.261369 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:52:44.261369 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:52:44.261369 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:52:44.261369 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:44.261369 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:52:44.261369 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:52:44.261369 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:52:44.261369 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:52:44.261369 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 026a3d00-8ac5-47b6-8202-39048ad9626b could not be found. Jul 12 14:52:44.261369 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:52:44.262756 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-00239657-1c7d-4ac3-aa92-b1a3e0448826 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Returning 404 to user: Instance 026a3d00-8ac5-47b6-8202-39048ad9626b could not be found. {{(pid=129980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:52:44.262756 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-00239657-1c7d-4ac3-aa92-b1a3e0448826 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b" status: 404 len: 111 microversion: 2.1 time: 0.029926 Jul 12 14:52:44.262756 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 611/1223] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:52:44 2022] GET /compute/v2.1/servers/026a3d00-8ac5-47b6-8202-39048ad9626b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:52:45.573398 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-14de0cbc-ae8d-4665-b5c1-c84aa5f1808e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:52:45.573964 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-14de0cbc-ae8d-4665-b5c1-c84aa5f1808e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:52:45.580400 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-14de0cbc-ae8d-4665-b5c1-c84aa5f1808e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:45.580848 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-14de0cbc-ae8d-4665-b5c1-c84aa5f1808e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:45.581645 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-14de0cbc-ae8d-4665-b5c1-c84aa5f1808e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:45.582708 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-14de0cbc-ae8d-4665-b5c1-c84aa5f1808e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:45.595952 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.wsgi [None req-14de0cbc-ae8d-4665-b5c1-c84aa5f1808e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] HTTP exception thrown: Instance ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 could not be found. Jul 12 14:52:45.597522 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-14de0cbc-ae8d-4665-b5c1-c84aa5f1808e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Request method failure captured: Jul 12 14:52:45.597522 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: DELETE /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 HTTP/1.1 Jul 12 14:52:45.597522 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:52:45.597522 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:52:45.597522 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:52:45.597522 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 0 Jul 12 14:52:45.597522 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:52:45.597522 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:52:45.597522 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:52:45.597522 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:52:45.597522 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYl36fzTwFtVGKGnuLeWSR2xyzHWwW-MuDxWxaXdj_iqJqN47gaidjWXHzGJk8xWf-7iIhGkO1yM8AnekzxjKftE8wUnGgFJsehPH1UO-4j29uRFi6cowSALtK5HCNwfqNyHXXw02fXyxBOCZ4tFJOEbNcuLcZWDT9MpBcZT-ODszdo Jul 12 14:52:45.597522 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:52:45.597522 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:52:45.597522 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:52:45.597522 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:52:45.597522 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:52:45.597522 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:52:45.597522 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: 35438fec2e37438e99201870e0d650af Jul 12 14:52:45.597522 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:52:45.597522 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:52:45.597522 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:52:45.599264 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35438fec2e37438e99201870e0d650af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/35438fec2e37438e99201870e0d650af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35438fec2e37438e99201870e0d650af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_35438fec2e37438e99201870e0d650af", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:52:45.599264 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:52:45.599264 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: 35438fec2e37438e99201870e0d650af Jul 12 14:52:45.599264 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:52:45.599264 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-AttachVolumeNegativeTest-1692963561-project Jul 12 14:52:45.599264 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:52:45.599264 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:52:45.599264 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: f926d674e2dc4eb58d7fe6379b79310b Jul 12 14:52:45.599264 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-AttachVolumeNegativeTest-1692963561-project Jul 12 14:52:45.599264 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: > Jul 12 14:52:45.599264 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Instance ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 could not be found. Jul 12 14:52:45.599264 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'id': 'ae44ec45-2b42-4f9e-8df7-e6a7c4c70218'} Jul 12 14:52:45.600194 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:52:45.600194 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:45.600194 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:52:45.600194 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:52:45.600194 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:52:45.600194 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:52:45.600194 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:52:45.600194 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:52:45.600194 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:52:45.600194 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:52:45.600194 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 could not be found. Jul 12 14:52:45.600194 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:45.600194 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:52:45.600194 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:45.600194 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:45.600194 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:52:45.600194 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:52:45.600194 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:52:45.600194 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:52:45.600194 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:52:45.601814 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:52:45.601814 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 14:52:45.601814 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 14:52:45.601814 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 14:52:45.601814 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 14:52:45.601814 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:52:45.601814 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:52:45.601814 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:52:45.601814 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:52:45.601814 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 could not be found. Jul 12 14:52:45.601814 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:45.601814 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:52:45.601814 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:45.601814 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:45.601814 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:52:45.601814 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:52:45.601814 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:52:45.601814 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:52:45.601814 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 could not be found. Jul 12 14:52:45.601814 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:45.603431 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-14de0cbc-ae8d-4665-b5c1-c84aa5f1808e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Returning 404 to user: Instance ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 could not be found. {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:52:45.603431 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-14de0cbc-ae8d-4665-b5c1-c84aa5f1808e tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218" status: 404 len: 111 microversion: 2.1 time: 0.029416 Jul 12 14:52:45.603431 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 613/1224] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Jul 12 14:52:45 2022] DELETE /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:52:45.607205 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-88961fc6-5161-4666-9b39-b584904a9152 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:52:45.614388 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-88961fc6-5161-4666-9b39-b584904a9152 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: ae44ec45-2b42-4f9e-8df7-e6a7c4c70218] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:52:45.614953 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-88961fc6-5161-4666-9b39-b584904a9152 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:45.614953 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-88961fc6-5161-4666-9b39-b584904a9152 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:45.615630 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-88961fc6-5161-4666-9b39-b584904a9152 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:45.616064 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-88961fc6-5161-4666-9b39-b584904a9152 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:45.630031 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.wsgi [None req-88961fc6-5161-4666-9b39-b584904a9152 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] HTTP exception thrown: Instance ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 could not be found. Jul 12 14:52:45.631589 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-88961fc6-5161-4666-9b39-b584904a9152 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Request method failure captured: Jul 12 14:52:45.631589 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: request: GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 HTTP/1.1 Jul 12 14:52:45.631589 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept: application/json Jul 12 14:52:45.631589 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept-Encoding: identity Jul 12 14:52:45.631589 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Connection: close Jul 12 14:52:45.631589 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Length: 0 Jul 12 14:52:45.631589 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Type: application/json Jul 12 14:52:45.631589 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Host: 10.222.0.30 Jul 12 14:52:45.631589 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Openstack-System-Scope: None Jul 12 14:52:45.631589 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: User-Agent: python-urllib3/1.26.9 Jul 12 14:52:45.631589 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Auth-Token: gAAAAABizYl36fzTwFtVGKGnuLeWSR2xyzHWwW-MuDxWxaXdj_iqJqN47gaidjWXHzGJk8xWf-7iIhGkO1yM8AnekzxjKftE8wUnGgFJsehPH1UO-4j29uRFi6cowSALtK5HCNwfqNyHXXw02fXyxBOCZ4tFJOEbNcuLcZWDT9MpBcZT-ODszdo Jul 12 14:52:45.631589 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Id: None Jul 12 14:52:45.631589 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Name: None Jul 12 14:52:45.631589 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Identity-Status: Confirmed Jul 12 14:52:45.631589 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Is-Admin-Project: True Jul 12 14:52:45.631589 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Id: default Jul 12 14:52:45.631589 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Name: Default Jul 12 14:52:45.631589 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Id: 35438fec2e37438e99201870e0d650af Jul 12 14:52:45.631589 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Name: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:52:45.631589 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Role: member,reader Jul 12 14:52:45.631589 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Roles: member,reader Jul 12 14:52:45.633347 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35438fec2e37438e99201870e0d650af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/35438fec2e37438e99201870e0d650af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35438fec2e37438e99201870e0d650af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_35438fec2e37438e99201870e0d650af", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:52:45.633347 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:52:45.633347 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Id: 35438fec2e37438e99201870e0d650af Jul 12 14:52:45.633347 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:52:45.633347 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User: tempest-AttachVolumeNegativeTest-1692963561-project Jul 12 14:52:45.633347 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Id: default Jul 12 14:52:45.633347 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Name: Default Jul 12 14:52:45.633347 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Id: f926d674e2dc4eb58d7fe6379b79310b Jul 12 14:52:45.633347 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Name: tempest-AttachVolumeNegativeTest-1692963561-project Jul 12 14:52:45.633347 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: method: > Jul 12 14:52:45.633347 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: exception: Instance ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 could not be found. Jul 12 14:52:45.633347 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: action_args: {'id': 'ae44ec45-2b42-4f9e-8df7-e6a7c4c70218'} Jul 12 14:52:45.634261 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:52:45.634261 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:45.634261 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:52:45.634261 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:52:45.634261 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:52:45.634261 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:52:45.634261 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:52:45.634261 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:52:45.634261 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:52:45.634261 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:52:45.634261 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 could not be found. Jul 12 14:52:45.634261 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:52:45.634261 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:52:45.634261 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:52:45.634261 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:45.634261 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:52:45.634261 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:52:45.634261 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:52:45.634261 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:52:45.634261 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:52:45.635599 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:52:45.635599 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:52:45.635599 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:52:45.635599 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:52:45.635599 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:52:45.635599 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:52:45.635599 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:52:45.635599 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 could not be found. Jul 12 14:52:45.635599 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:52:45.635599 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:52:45.635599 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:52:45.635599 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:45.635599 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:52:45.635599 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:52:45.635599 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:52:45.635599 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:52:45.635599 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 could not be found. Jul 12 14:52:45.635599 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:52:45.637194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-88961fc6-5161-4666-9b39-b584904a9152 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Returning 404 to user: Instance ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 could not be found. {{(pid=129980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:52:45.637194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-88961fc6-5161-4666-9b39-b584904a9152 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218" status: 404 len: 111 microversion: 2.1 time: 0.029559 Jul 12 14:52:45.637194 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 612/1225] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:52:45 2022] GET /compute/v2.1/servers/ae44ec45-2b42-4f9e-8df7-e6a7c4c70218 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 14:52:45.641626 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c4e03727-398d-47d2-aeeb-bad973e78715 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:52:45.642123 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-c4e03727-398d-47d2-aeeb-bad973e78715 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:52:45.649078 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c4e03727-398d-47d2-aeeb-bad973e78715 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:45.654292 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c4e03727-398d-47d2-aeeb-bad973e78715 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:45.654292 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c4e03727-398d-47d2-aeeb-bad973e78715 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:45.654292 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-c4e03727-398d-47d2-aeeb-bad973e78715 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:45.664057 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.wsgi [None req-c4e03727-398d-47d2-aeeb-bad973e78715 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] HTTP exception thrown: Instance 4370218b-d99a-4484-829d-ffa09e867627 could not be found. Jul 12 14:52:45.665619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c4e03727-398d-47d2-aeeb-bad973e78715 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Request method failure captured: Jul 12 14:52:45.665619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: DELETE /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 HTTP/1.1 Jul 12 14:52:45.665619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:52:45.665619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:52:45.665619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:52:45.665619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 0 Jul 12 14:52:45.665619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:52:45.665619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:52:45.665619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:52:45.665619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:52:45.665619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYl36fzTwFtVGKGnuLeWSR2xyzHWwW-MuDxWxaXdj_iqJqN47gaidjWXHzGJk8xWf-7iIhGkO1yM8AnekzxjKftE8wUnGgFJsehPH1UO-4j29uRFi6cowSALtK5HCNwfqNyHXXw02fXyxBOCZ4tFJOEbNcuLcZWDT9MpBcZT-ODszdo Jul 12 14:52:45.665619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:52:45.665619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:52:45.665619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:52:45.665619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:52:45.665619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:52:45.665619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:52:45.665619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: 35438fec2e37438e99201870e0d650af Jul 12 14:52:45.665619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:52:45.665619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:52:45.665619 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:52:45.667312 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35438fec2e37438e99201870e0d650af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/35438fec2e37438e99201870e0d650af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35438fec2e37438e99201870e0d650af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_35438fec2e37438e99201870e0d650af", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:52:45.667312 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:52:45.667312 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: 35438fec2e37438e99201870e0d650af Jul 12 14:52:45.667312 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:52:45.667312 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-AttachVolumeNegativeTest-1692963561-project Jul 12 14:52:45.667312 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:52:45.667312 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:52:45.667312 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: f926d674e2dc4eb58d7fe6379b79310b Jul 12 14:52:45.667312 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-AttachVolumeNegativeTest-1692963561-project Jul 12 14:52:45.667312 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: > Jul 12 14:52:45.667312 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Instance 4370218b-d99a-4484-829d-ffa09e867627 could not be found. Jul 12 14:52:45.667312 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'id': '4370218b-d99a-4484-829d-ffa09e867627'} Jul 12 14:52:45.668166 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:52:45.668166 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:45.668166 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:52:45.668166 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:52:45.668166 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:52:45.668166 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:52:45.668166 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:52:45.668166 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:52:45.668166 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:52:45.668166 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:52:45.668166 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4370218b-d99a-4484-829d-ffa09e867627 could not be found. Jul 12 14:52:45.668166 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:45.668166 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:52:45.668166 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:45.668166 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:45.668166 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:52:45.668166 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:52:45.668166 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:52:45.668166 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:52:45.668166 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:52:45.669570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:52:45.669570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 14:52:45.669570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 14:52:45.669570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 14:52:45.669570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 14:52:45.669570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:52:45.669570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:52:45.669570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:52:45.669570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:52:45.669570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4370218b-d99a-4484-829d-ffa09e867627 could not be found. Jul 12 14:52:45.669570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:45.669570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:52:45.669570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:45.669570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:45.669570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:52:45.669570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:52:45.669570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:52:45.669570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:52:45.669570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4370218b-d99a-4484-829d-ffa09e867627 could not be found. Jul 12 14:52:45.669570 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:45.671044 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-c4e03727-398d-47d2-aeeb-bad973e78715 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Returning 404 to user: Instance 4370218b-d99a-4484-829d-ffa09e867627 could not be found. {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:52:45.671044 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-c4e03727-398d-47d2-aeeb-bad973e78715 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627" status: 404 len: 111 microversion: 2.1 time: 0.029612 Jul 12 14:52:45.671044 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 614/1226] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Jul 12 14:52:45 2022] DELETE /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 14:52:45.675320 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0c8dd057-77a8-42f0-b01b-032101712663 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:52:45.675932 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-0c8dd057-77a8-42f0-b01b-032101712663 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: 4370218b-d99a-4484-829d-ffa09e867627] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:52:45.682062 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0c8dd057-77a8-42f0-b01b-032101712663 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:45.682515 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0c8dd057-77a8-42f0-b01b-032101712663 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:45.683275 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0c8dd057-77a8-42f0-b01b-032101712663 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:45.683715 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-0c8dd057-77a8-42f0-b01b-032101712663 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:45.697463 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.wsgi [None req-0c8dd057-77a8-42f0-b01b-032101712663 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] HTTP exception thrown: Instance 4370218b-d99a-4484-829d-ffa09e867627 could not be found. Jul 12 14:52:45.698960 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0c8dd057-77a8-42f0-b01b-032101712663 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Request method failure captured: Jul 12 14:52:45.698960 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: request: GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 HTTP/1.1 Jul 12 14:52:45.698960 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept: application/json Jul 12 14:52:45.698960 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept-Encoding: identity Jul 12 14:52:45.698960 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Connection: close Jul 12 14:52:45.698960 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Length: 0 Jul 12 14:52:45.698960 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Type: application/json Jul 12 14:52:45.698960 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Host: 10.222.0.30 Jul 12 14:52:45.698960 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Openstack-System-Scope: None Jul 12 14:52:45.698960 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: User-Agent: python-urllib3/1.26.9 Jul 12 14:52:45.698960 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Auth-Token: gAAAAABizYl36fzTwFtVGKGnuLeWSR2xyzHWwW-MuDxWxaXdj_iqJqN47gaidjWXHzGJk8xWf-7iIhGkO1yM8AnekzxjKftE8wUnGgFJsehPH1UO-4j29uRFi6cowSALtK5HCNwfqNyHXXw02fXyxBOCZ4tFJOEbNcuLcZWDT9MpBcZT-ODszdo Jul 12 14:52:45.698960 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Id: None Jul 12 14:52:45.698960 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Name: None Jul 12 14:52:45.698960 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Identity-Status: Confirmed Jul 12 14:52:45.698960 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Is-Admin-Project: True Jul 12 14:52:45.698960 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Id: default Jul 12 14:52:45.698960 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Name: Default Jul 12 14:52:45.698960 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Id: 35438fec2e37438e99201870e0d650af Jul 12 14:52:45.698960 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Name: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:52:45.698960 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Role: member,reader Jul 12 14:52:45.698960 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Roles: member,reader Jul 12 14:52:45.700631 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35438fec2e37438e99201870e0d650af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/35438fec2e37438e99201870e0d650af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35438fec2e37438e99201870e0d650af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_35438fec2e37438e99201870e0d650af", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:52:45.700631 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:52:45.700631 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Id: 35438fec2e37438e99201870e0d650af Jul 12 14:52:45.700631 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:52:45.700631 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User: tempest-AttachVolumeNegativeTest-1692963561-project Jul 12 14:52:45.700631 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Id: default Jul 12 14:52:45.700631 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Name: Default Jul 12 14:52:45.700631 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Id: f926d674e2dc4eb58d7fe6379b79310b Jul 12 14:52:45.700631 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Name: tempest-AttachVolumeNegativeTest-1692963561-project Jul 12 14:52:45.700631 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: method: > Jul 12 14:52:45.700631 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: exception: Instance 4370218b-d99a-4484-829d-ffa09e867627 could not be found. Jul 12 14:52:45.700631 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: action_args: {'id': '4370218b-d99a-4484-829d-ffa09e867627'} Jul 12 14:52:45.701615 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:52:45.701615 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:45.701615 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:52:45.701615 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:52:45.701615 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:52:45.701615 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:52:45.701615 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:52:45.701615 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:52:45.701615 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:52:45.701615 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:52:45.701615 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4370218b-d99a-4484-829d-ffa09e867627 could not be found. Jul 12 14:52:45.701615 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:52:45.701615 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:52:45.701615 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:52:45.701615 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:45.701615 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:52:45.701615 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:52:45.701615 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:52:45.701615 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:52:45.701615 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:52:45.703289 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:52:45.703289 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:52:45.703289 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:52:45.703289 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:52:45.703289 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:52:45.703289 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:52:45.703289 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:52:45.703289 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4370218b-d99a-4484-829d-ffa09e867627 could not be found. Jul 12 14:52:45.703289 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:52:45.703289 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:52:45.703289 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:52:45.703289 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:45.703289 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:52:45.703289 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:52:45.703289 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:52:45.703289 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:52:45.703289 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4370218b-d99a-4484-829d-ffa09e867627 could not be found. Jul 12 14:52:45.703289 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:52:45.708148 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-0c8dd057-77a8-42f0-b01b-032101712663 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Returning 404 to user: Instance 4370218b-d99a-4484-829d-ffa09e867627 could not be found. {{(pid=129980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:52:45.708148 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-0c8dd057-77a8-42f0-b01b-032101712663 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627" status: 404 len: 111 microversion: 2.1 time: 0.028780 Jul 12 14:52:45.708148 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 613/1227] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:52:45 2022] GET /compute/v2.1/servers/4370218b-d99a-4484-829d-ffa09e867627 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 14:52:47.152873 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-386bfdb8-6b86-42bd-b066-5e40c8452e66 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:52:47.153427 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.compute.api [None req-386bfdb8-6b86-42bd-b066-5e40c8452e66 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Fetching instance by UUID {{(pid=129981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:52:47.160495 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-386bfdb8-6b86-42bd-b066-5e40c8452e66 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:47.160953 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-386bfdb8-6b86-42bd-b066-5e40c8452e66 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:47.161754 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-386bfdb8-6b86-42bd-b066-5e40c8452e66 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:47.162195 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG oslo_concurrency.lockutils [None req-386bfdb8-6b86-42bd-b066-5e40c8452e66 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:47.175550 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.wsgi [None req-386bfdb8-6b86-42bd-b066-5e40c8452e66 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] HTTP exception thrown: Instance beb4b4d2-0edd-494b-958c-72c59082d35e could not be found. Jul 12 14:52:47.177691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-386bfdb8-6b86-42bd-b066-5e40c8452e66 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Request method failure captured: Jul 12 14:52:47.177691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: request: DELETE /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e HTTP/1.1 Jul 12 14:52:47.177691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept: application/json Jul 12 14:52:47.177691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Accept-Encoding: identity Jul 12 14:52:47.177691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Connection: close Jul 12 14:52:47.177691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Length: 0 Jul 12 14:52:47.177691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Content-Type: application/json Jul 12 14:52:47.177691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Host: 10.222.0.30 Jul 12 14:52:47.177691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Openstack-System-Scope: None Jul 12 14:52:47.177691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: User-Agent: python-urllib3/1.26.9 Jul 12 14:52:47.177691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Auth-Token: gAAAAABizYl36fzTwFtVGKGnuLeWSR2xyzHWwW-MuDxWxaXdj_iqJqN47gaidjWXHzGJk8xWf-7iIhGkO1yM8AnekzxjKftE8wUnGgFJsehPH1UO-4j29uRFi6cowSALtK5HCNwfqNyHXXw02fXyxBOCZ4tFJOEbNcuLcZWDT9MpBcZT-ODszdo Jul 12 14:52:47.177691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Id: None Jul 12 14:52:47.177691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Domain-Name: None Jul 12 14:52:47.177691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Identity-Status: Confirmed Jul 12 14:52:47.177691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Is-Admin-Project: True Jul 12 14:52:47.177691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Id: default Jul 12 14:52:47.177691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Domain-Name: Default Jul 12 14:52:47.177691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Id: 35438fec2e37438e99201870e0d650af Jul 12 14:52:47.177691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Project-Name: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:52:47.177691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Role: member,reader Jul 12 14:52:47.177691 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Roles: member,reader Jul 12 14:52:47.179507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35438fec2e37438e99201870e0d650af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/35438fec2e37438e99201870e0d650af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35438fec2e37438e99201870e0d650af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_35438fec2e37438e99201870e0d650af", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:52:47.179507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:52:47.179507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Id: 35438fec2e37438e99201870e0d650af Jul 12 14:52:47.179507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:52:47.179507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User: tempest-AttachVolumeNegativeTest-1692963561-project Jul 12 14:52:47.179507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Id: default Jul 12 14:52:47.179507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Domain-Name: Default Jul 12 14:52:47.179507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Id: f926d674e2dc4eb58d7fe6379b79310b Jul 12 14:52:47.179507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: X-User-Name: tempest-AttachVolumeNegativeTest-1692963561-project Jul 12 14:52:47.179507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: method: > Jul 12 14:52:47.179507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: exception: Instance beb4b4d2-0edd-494b-958c-72c59082d35e could not be found. Jul 12 14:52:47.179507 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: action_args: {'id': 'beb4b4d2-0edd-494b-958c-72c59082d35e'} Jul 12 14:52:47.180630 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: {{(pid=129981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:52:47.180630 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:47.180630 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:52:47.180630 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:52:47.180630 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:52:47.180630 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:52:47.180630 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:52:47.180630 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:52:47.180630 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:52:47.180630 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:52:47.180630 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beb4b4d2-0edd-494b-958c-72c59082d35e could not be found. Jul 12 14:52:47.180630 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:47.180630 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:52:47.180630 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:47.180630 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:47.180630 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:52:47.180630 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:52:47.180630 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:52:47.180630 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:52:47.180630 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:52:47.182270 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:52:47.182270 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 14:52:47.182270 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 14:52:47.182270 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 14:52:47.182270 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 14:52:47.182270 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:52:47.182270 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:52:47.182270 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:52:47.182270 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:52:47.182270 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beb4b4d2-0edd-494b-958c-72c59082d35e could not be found. Jul 12 14:52:47.182270 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:47.182270 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:52:47.182270 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:47.182270 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:47.182270 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:52:47.182270 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:52:47.182270 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:52:47.182270 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:52:47.182270 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beb4b4d2-0edd-494b-958c-72c59082d35e could not be found. Jul 12 14:52:47.182270 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: ERROR nova.api.openstack.wsgi Jul 12 14:52:47.183856 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: DEBUG nova.api.openstack.wsgi [None req-386bfdb8-6b86-42bd-b066-5e40c8452e66 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Returning 404 to user: Instance beb4b4d2-0edd-494b-958c-72c59082d35e could not be found. {{(pid=129981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:52:47.183856 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO nova.api.openstack.requestlog [None req-386bfdb8-6b86-42bd-b066-5e40c8452e66 tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "DELETE /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e" status: 404 len: 111 microversion: 2.1 time: 0.030034 Jul 12 14:52:47.183856 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: [pid: 129981|app: 0|req: 615/1228] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Jul 12 14:52:47 2022] DELETE /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:52:47.187389 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-6b5ad28d-9fde-48a9-984f-b79e3e658c3a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Calling method '>' {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:52:47.188011 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.compute.api [None req-6b5ad28d-9fde-48a9-984f-b79e3e658c3a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] [instance: beb4b4d2-0edd-494b-958c-72c59082d35e] Fetching instance by UUID {{(pid=129980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:52:47.190537 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=2 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:47.195306 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6b5ad28d-9fde-48a9-984f-b79e3e658c3a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:47.195761 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6b5ad28d-9fde-48a9-984f-b79e3e658c3a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:47.196568 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6b5ad28d-9fde-48a9-984f-b79e3e658c3a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:52:47.197016 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG oslo_concurrency.lockutils [None req-6b5ad28d-9fde-48a9-984f-b79e3e658c3a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Lock "c5d3242d-677e-4e4e-9b6c-5b2cefa9ecda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:52:47.200944 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG dbcounter [-] [129980] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:47.212086 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.wsgi [None req-6b5ad28d-9fde-48a9-984f-b79e3e658c3a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] HTTP exception thrown: Instance beb4b4d2-0edd-494b-958c-72c59082d35e could not be found. Jul 12 14:52:47.213628 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-6b5ad28d-9fde-48a9-984f-b79e3e658c3a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Request method failure captured: Jul 12 14:52:47.213628 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: request: GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e HTTP/1.1 Jul 12 14:52:47.213628 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept: application/json Jul 12 14:52:47.213628 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Accept-Encoding: identity Jul 12 14:52:47.213628 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Connection: close Jul 12 14:52:47.213628 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Length: 0 Jul 12 14:52:47.213628 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Content-Type: application/json Jul 12 14:52:47.213628 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Host: 10.222.0.30 Jul 12 14:52:47.213628 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Openstack-System-Scope: None Jul 12 14:52:47.213628 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: User-Agent: python-urllib3/1.26.9 Jul 12 14:52:47.213628 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Auth-Token: gAAAAABizYl36fzTwFtVGKGnuLeWSR2xyzHWwW-MuDxWxaXdj_iqJqN47gaidjWXHzGJk8xWf-7iIhGkO1yM8AnekzxjKftE8wUnGgFJsehPH1UO-4j29uRFi6cowSALtK5HCNwfqNyHXXw02fXyxBOCZ4tFJOEbNcuLcZWDT9MpBcZT-ODszdo Jul 12 14:52:47.213628 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Id: None Jul 12 14:52:47.213628 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Domain-Name: None Jul 12 14:52:47.213628 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Identity-Status: Confirmed Jul 12 14:52:47.213628 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Is-Admin-Project: True Jul 12 14:52:47.213628 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Id: default Jul 12 14:52:47.213628 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Domain-Name: Default Jul 12 14:52:47.213628 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Id: 35438fec2e37438e99201870e0d650af Jul 12 14:52:47.213628 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Project-Name: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:52:47.213628 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Role: member,reader Jul 12 14:52:47.213628 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Roles: member,reader Jul 12 14:52:47.215334 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35438fec2e37438e99201870e0d650af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/35438fec2e37438e99201870e0d650af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35438fec2e37438e99201870e0d650af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_35438fec2e37438e99201870e0d650af", "adminURL": "http://10.222.0.30:8080"}]}] Jul 12 14:52:47.215334 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:52:47.215334 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Id: 35438fec2e37438e99201870e0d650af Jul 12 14:52:47.215334 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1692963561 Jul 12 14:52:47.215334 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User: tempest-AttachVolumeNegativeTest-1692963561-project Jul 12 14:52:47.215334 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Id: default Jul 12 14:52:47.215334 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Domain-Name: Default Jul 12 14:52:47.215334 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Id: f926d674e2dc4eb58d7fe6379b79310b Jul 12 14:52:47.215334 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: X-User-Name: tempest-AttachVolumeNegativeTest-1692963561-project Jul 12 14:52:47.215334 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: method: > Jul 12 14:52:47.215334 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: exception: Instance beb4b4d2-0edd-494b-958c-72c59082d35e could not be found. Jul 12 14:52:47.215334 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: action_args: {'id': 'beb4b4d2-0edd-494b-958c-72c59082d35e'} Jul 12 14:52:47.216486 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: {{(pid=129980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:52:47.216486 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:47.216486 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:52:47.216486 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:52:47.216486 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:52:47.216486 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:52:47.216486 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:52:47.216486 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:52:47.216486 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:52:47.216486 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:52:47.216486 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beb4b4d2-0edd-494b-958c-72c59082d35e could not be found. Jul 12 14:52:47.216486 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:52:47.216486 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:52:47.216486 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:52:47.216486 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:47.216486 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:52:47.216486 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:52:47.216486 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:52:47.216486 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:52:47.216486 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:52:47.218106 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:52:47.218106 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:52:47.218106 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:52:47.218106 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:52:47.218106 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:52:47.218106 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:52:47.218106 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:52:47.218106 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beb4b4d2-0edd-494b-958c-72c59082d35e could not be found. Jul 12 14:52:47.218106 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:52:47.218106 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:52:47.218106 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:52:47.218106 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:52:47.218106 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:52:47.218106 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:52:47.218106 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:52:47.218106 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:52:47.218106 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beb4b4d2-0edd-494b-958c-72c59082d35e could not be found. Jul 12 14:52:47.218106 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: ERROR nova.api.openstack.wsgi Jul 12 14:52:47.219649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: DEBUG nova.api.openstack.wsgi [None req-6b5ad28d-9fde-48a9-984f-b79e3e658c3a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] Returning 404 to user: Instance beb4b4d2-0edd-494b-958c-72c59082d35e could not be found. {{(pid=129980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:52:47.219649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO nova.api.openstack.requestlog [None req-6b5ad28d-9fde-48a9-984f-b79e3e658c3a tempest-AttachVolumeNegativeTest-1692963561 tempest-AttachVolumeNegativeTest-1692963561-project] 10.222.0.30 "GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e" status: 404 len: 111 microversion: 2.1 time: 0.031421 Jul 12 14:52:47.219649 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: [pid: 129980|app: 0|req: 614/1229] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Jul 12 14:52:47 2022] GET /compute/v2.1/servers/beb4b4d2-0edd-494b-958c-72c59082d35e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:52:53.639017 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 14:52:53.639559 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Tue Jul 12 14:52:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 14:54:35.075414 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 14:54:35.076192 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Tue Jul 12 14:54:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 14:54:38.533396 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 14:54:38.533982 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Tue Jul 12 14:54:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 14:54:51.459815 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 14:54:51.460422 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Tue Jul 12 14:54:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 14:54:57.222441 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 14:54:57.223761 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Tue Jul 12 14:54:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 14:56:13.648819 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 14:56:13.649562 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Tue Jul 12 14:56:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 14:57:48.346435 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 14:57:48.347031 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Tue Jul 12 14:57:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 14:57:55.084881 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 14:57:55.085458 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Tue Jul 12 14:57:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 14:57:58.542351 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 14:57:58.542801 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Tue Jul 12 14:57:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 14:58:11.467896 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 14:58:11.468461 dv-cinder-820027-12-iscsi devstack@n-api.service[129980]: Tue Jul 12 14:58:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 14:58:17.230916 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 14:58:17.231488 dv-cinder-820027-12-iscsi devstack@n-api.service[129981]: Tue Jul 12 14:58:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!